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(54) IMAGE PROCESSING UNIT 
(57)Abstract-* 

PROBLEM TO BE SOLVED: To provide a image processing nit, where artifacts hardly 
take place at all parts of an image and missing color signals are restored to generate an 
image with high quality. 

SOLUTION: An area extract section 20 extracts plural image area from each pixel of an 
input image, a means variance evaluation section 24 and a parameter calculation 
section 28 estimate color correlation on each extracted image area to obtain a parameter. 
Then a parameter evaluation section 32 evaluates the reliability of each parameter 
estimated by the means variance evaluation section 24 and the parameter calculation 
section 28 and gives only the parameters with high reliability to a pixel restoring 
section 34. The pixel restoring section 34 restores a color signal value of each pixel of the 
input image, based on only the parameters relating to the pixel among received 
parameters. 
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CLAIMS 



[Claim(s)] 

[Claim l] In the image processing system which inputs the digital image which was 
obtained by the veneer image pick-up system or the 2 plate image pick-up system, and 
which lacks one or more kinds of chrominance -signal values about each pixel, presumes 
the lack chrominance -signal value of each pixel, and outputs a color digital image A field 
extract means to extract the image field in which plurality is different from each other 
per each pixel from the digital image which lacks the above-mentioned 
chrominance-signal value, A hue Seki parameter estimation means to presume the hue 
Seki parameter showing hue Seki on the image field based on the chrominance -signal 
value which exists on the image field to each image field extracted by the 
above-mentioned field extract means, The dependability of each hue Seki parameter 



presumed by the above-mentioned hue Seki parameter estimation means is evaluated 
based on the chrominance -signal value on the image field corresponding to the hue Seki 
parameter and its hue Seki parameter. A parameter selection means to select only a 
reliable hue Seki parameter, As opposed to each pixel of the digital image which lacks 
the above-mentioned chrominance signal value The image processing system 
characterized by providing a restoration means to restore the lack chrominance-signal 
value of the pixel based on the chrominance-signal value which exists in the pixel, and 
the thing in which the image field which corresponds among the hue Seki parameters 
selected by the above-mentioned hue Seki parameter selection means includes the pixel. 
[Claim 2] In the image processing system which inputs the digital image which was 
obtained by the veneer image pick-up system or the 2 plate image pick-up system, and 
which lacks one or more kinds of chrominance -signal values about each pixel, presumes 
the lack chrominance -signal value of each pixel, and outputs a color digital image Afield 
extract means to extract the image field in which plurality is different from each other 
per each pixel from the digital image which lacks the above-mentioned 
chrominance-signal value, A hue Seki parameter estimation means to presume the hue 
Seki parameter showing hue Seki on the image field based on the chrominance-signal 
value which exists on the image field to each image field extracted by the 
above-mentioned field extract means, A field restoration means to restore the lack 
chrominance-signal value on each image field from the hue Seki parameter 
corresponding to the image field, and the chrominance -signal value which exists in each 
pixel, and to generate a restoration image field, A restoration field selection means to 
select the restoration image field which evaluated the dependability of a restoration 
result based on the chrominance -signal value on the restoration image field, and was 
estimated to be reliable to each restoration image field generated by the 
above-mentioned field restoration means, The image processing system characterized 
by providing a pixel restoration means to restore the lack chrominance-signal value of 
the pixel based on what contains the pixel among the restoration image fields selected 
by the above-mentioned restoration field selection means, to each pixel of the digital 
image which lacks the above-mentioned chrominance -signal value. 

[Claim 3] A characteristic quantity calculation means by which the above-mentioned 
field extract means calculates the predetermined characteristic quantity relevant to a 
hue Seki parameter based on the chrominance-signal value which exists near the pixel 
in each pixel of the above-mentioned digital image, The image processing system 
according to claim 1 or 2 characterized by having a division means to divide into two or 
more image fields near each pixel of the above-mentioned digital image based on the 



characteristic quantity computed by the above-mentioned characteristic quantity 
calculation means, and extracting each divided image field. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] Since the image processing system which outputs the color 
digital image expressed by two or more sorts of chrominance -signal values cost the color 
of each pixel and it was especially obtained by the veneer image pick-up system or the 2 
plate image pick-up system, this invention inputs the digital image which lacks one or 
more kinds of chrominance -signal values about each pixel, and it relates to the image 
processing system which outputs the color digital image with which the lack 
chrominance -signal value in each pixel was compensated. 
[0002] 

[Description of the Prior Art] the 2 plate image pick-up system in which, as for the 
veneer image pick-up system using the image sensor which arranged the color filter on 
the light-receiving side in the shape of a mosaic, and one sheet, only G (green) filter 
picturizes by CCD of two sheets which, as for one more sheet, arranged the mosaic filter 
of R (red) and B (blue) -- a spectrum " it has the advantage that it can constitute 
cheaply to a system and the 3 plate image pick-up system using the image sensor of 
three sheets. However, by these image pick-up systems, in order that at least one or 
more chrominance -signal values may be missing in each pixel of the obtained image, the 
interpolation processing with which the chrominance -signal value is presumed and 
compensated is needed. 

[0003] Simple linear interpolation processing by which the chrominance -signal value 
which lacks a certain pixel is compensated with the average of the chrominance -signal 
value of the same kind which does not lack that perimeter as this interpolation 
processing has been performed widely conventionally. However, in the processing result, 
the phenomenon of degrading image quality produces irregularity of a false color and 
the edge section, coloring, etc. according to color filter arrangement. Therefore, the 
restoration technique of the new lack chrominance-signal value which suppresses 
generating of these phenomena and raises image quality is proposed. The improvement 



effectiveness in image quality has the high approach of compensating a lack 
chrominance-signal value especially using the relation between the chrominance -signal 
values in the partial field of a color picture, and the so-called hue Seki. 
[0004] For example, as the first example, the interpolation to the chrominance signal of 
a low sampling consistency is indicated by JP,4*502096,A in the picture signal with 
which a luminance signal is acquired by the high sampling consistency, and other 
chrominance signals are relatively acquired by the low sampling consistency. By this 
approach, the chrominance signal of a low sampling consistency is computed using the 
luminance signal of a high sampling consistency. For this reason, it is assumed that the 
sampled value of the signal Si of a high sampling consistency surely exists in the 
sampling position of the signal S2 of a low sampling consistency. When less [ the 
difference between the sampled value of Si in the sampling position of a signal S2 ] 
than a threshold as compared with a predetermined threshold, simple linear 
interpolation processing which used only the sampled value of a signal S2 is performed. 
When exceeding a threshold, it judges that an edge is between the sampling positions of 
a signal S2, and it assumes that it has the linearity relation which SI and S2 
S2=a*Sl+b Become, and multipliers a and b are calculated from the value of Si and S2 
in the sampling position of S2. 

[0005] As the second example, moreover, in JP,5*56446,AIn the partial field of an image, 
it is assumed that change of a color is looser than change of brightness. 2-dimensional 
low-pass processing of each chrominance signal of N class acquired in the color video 
camera is carried out. From L chrominance -signal value (any ofl-N is L?) which exists K 
chrominance -signal value (any ofl-N is K?) which is missing in a certain pixel P in the 
pixel P to a formula K=(Klow/Llow) xL It computes. Klow and Llow It is a value in the 
pixel P of the signal which carried out low-pass processing of K chrominance signal and 
the L chrominance signal, respectively. t 
[0006] 

[Problem(s) to be Solved by the Invention] Each conventional technique of using hue 
Seki forms a certain assumption about the property of hue Seki which a common image 
has, and it processes noting that the assumption is materialized near each pixel. 
[0007] However, with these conventional techniques, there is also a pixel which has 
near where the prepared assumption is not materialized in an image, an artifact (the 
image description which originally does not exist) arises in the processing result of such 
a part, and the point that image quality deteriorates on the contrary is not indicated. 
[0008] Moreover, also about the pixel in which the assumption about hue Seki is 
materialized, with the conventional technique, it took only near [ one ] per each pixel, 



and the lack chrominance -signal value was restored in near using hue Seki in the near. 
Therefore, the point that a restoration result is weak in a noise is not indicated. 
[0009] This invention by restoring a lack chrominance -signal value only using the 
information on the field which was made in view of the above-mentioned point, judged 
whether it would be materialized in a field with the assumption prepared about hue 
Seki, and was judged that an assumption is materialized It aims at offering the image 
processing system which can restore the lack chrominance -signal value which can 
generate a high -definition image that it is hard to produce an artifact by all the parts of 
an image. 

[0010] Moreover, this invention aims at offering the image processing system which can 
restore a lack chrominance-signal value strong against a noise by processing by 
synthesizing hue Seki of two or more near related with the pixel of opposite Perilla 
frutescens (L.) Britton var. crispa (Thunb.) Decne. to a certain pixel. 
[0011] 

[Means for Solving the Problem] In order to attain the above-mentioned purpose, the 
image processing system by this invention The digital image which was obtained by the 
veneer image pick-up system or the 2 plate image pick-up system and which lacks one 
or more kinds of chrominance -signal values about each pixel is inputted. A field extract 
means to extract the image field in which plurality is different from each other per each 
pixel from the digital image which it is the image processing system which presumes 
the lack chrominance -signal value of each pixel, and outputs a color digital image, and 
lacks the above-mentioned chrominance-signal value, A hue Seki parameter estimation 
means to presume the hue Seki parameter showing hue Seki on the image field based 
on the chrominance -signal value which exists on the image field to each image field 
extracted by the above-mentioned field extract means, The dependability of each hue 
Seki parameter presumed by the above-mentioned hue Seki parameter estimation 
means is evaluated based on the chrominance "signal value on the image field 
corresponding to the hue Seki parameter and its hue Seki parameter. A parameter 
selection means to select only a reliable hue Seki parameter, As opposed to each pixel of 
the digital image which lacks the above-mentioned chrominance -signal value It is 
characterized by having a restoration means to restore the lack chrominance -signal 
value of the pixel based on the chrominance-signal value which exists in the pixel, and 
the thing in which the image field which corresponds among the hue Seki parameters 
selected by the above-mentioned hue Seki parameter selection means includes the pixel. 
[0012] That is, according to the image processing system of this invention, a field 
extract means extracts two or more image fields per each pixel of an input image, and a 



hue Seki parameter estimation means presumes and parameterizes hue Seki on an 
image field to each extracted image field. And a parameter selection means evaluates 
the dependability of each parameter presumed by the hue Seki parameter estimation 
means, and sends only a reliable parameter to a restoration means. With a restoration 
means, the chrominance-signal value of the pixel is restored in each pixel of an input 
image based on the thing relevant to the pixel among the sent parameters. 
[0013] Therefore, since two or more image fields are taken to each pixel of an input 
image and only what has high dependability is selected among the hue Seki parameters 
on each image field, the artifact produced by using an unreliable parameter can be 
controlled. Moreover, since restoration of the lack chrominance -signal value of each 
pixel is performed from two or more hue Seki parameters in relation to the pixel, 
restoration strong against a noise is attained. 

[0014] Moreover, the image processing system by this invention was obtained by the 
veneer image pick-up system or the 2 plate image pick-up system. The digital image 
which lacks one or more kinds of chrominance -signal values about each pixel is inputted. 
A field extract means to extract the image field in which plurality is different from each 
other per each pixel from the digital image which it is the image processing system 
which presumes the lack chrominance-signal value of each pixel, and outputs a color 
digital image, and lacks the above-mentioned chrominance -signal value, A hue Seki 
parameter estimation means to presume the hue Seki parameter showing hue Seki on 
the image field based on the chrominance -signal value which exists on the image field to 
each image field extracted by the above-mentioned field extract means, A field 
restoration means to restore the lack chrominance-signal value on each image field from 
the hue Seki parameter corresponding to the image field, and the chrominance-signal 
value which exists in each pixel, and to generate a restoration image field, A restoration 
field selection means to select the restoration image field which evaluated the 
dependability of a restoration result based on the chrominance-signal value on the 
restoration image field, and was estimated to be reliable to each restoration image field 
generated by the above-mentioned field restoration means, It is characterized by having 
a pixel restoration means to restore the lack chrominance-signal value of the pixel 
based on what contains the pixel among the restoration image fields selected by the 
above-mentioned restoration field selection means, to each pixel of the digital image 
which lacks the above-mentioned chrominance-signal value. 

[0015] That is, according to the image processing system of this invention, a field 
extract means extracts two or more image fields per each pixel of an input image, and a 
hue Seki parameter estimation means presumes and parameterizes hue Seki on an 



image field to each extracted image field. And the lack chrominance-signal value in each 
pixel on the image field where a field restoration means corresponds per [ which was 
presumed ] each parameter is restored, and the restoration image field of a color is 
generated. This processing is performed based on each hue Seki parameter and the 
chrominance -signal value which already exists on a corresponding image field. If 
lessons is taken from each hue Seki parameter and a restoration image field is 
generated in this way, a restoration field selection means will select only the restoration 
image field which evaluated the dependability of a restoration result based on the 
chrominance -signal value on each restoration image field, and was estimated to be 
reliable. With a pixel restoration means, the chrominance -signal value of the pixel is 
restored in each pixel of an input image based on what includes the pixel among the 
restoration image fields selected by the restoration field selection means. 
[0016] Therefore, two or more image fields are taken to each pixel of an input image, 
and the lack chrominance-signal value on each image field is restored based on the hue 
Seki parameter on the image field. Since only the restoration result judged to be reliable 
is selected and it is used for restoration of the lack chrominance -signal value of each 
pixel, the artifact produced by using an unreliable restoration result can be controlled. 
Moreover, since restoration of the lack chrominance -signal value of each pixel is 
performed based on two or more restoration results in relation to the pixel, restoration 
strong against a noise is attained. Furthermore, since the restoration result of each 
image field is used for the judgment of the dependability of direct restoration, 
processing with more certainly efficient evaluation of dependability is attained. 
[0017] 

[Embodiment of the Invention] Hereafter, the gestalt of operation of this invention is 
explained with reference to a drawing. 

[0018] [Gestalt of the 1st operation] drawing 1 is drawing showing the electronic camera 
structure of a system to which the image processing system concerning the gestalt of 
operation of the 1st of this invention was applied. 

[0019] This electronic camera system consists of bodies 12 of a processor by which cable 
splicing was carried out to the electronic camera 10 and this electronic camera 10. 
[0020] Into the electronic camera 10, the veneer primary color CCD 14 and A/D 
converter 16 are allotted, and the output of A/D converter 16 is connected so that the 
input image buffer 18 constituted in the body 12 may be supplied. 

[0021] In the body 12, the field extract section 20, the field buffer 22, average / 
distribution evaluation section 24, the filter arrangement maintenance ROM 26, the 
parameter calculation section 28, the parameter buffer 30, the parameter evaluation 



section 32, the pixel restoration section 34, and the output image buffer 36 other than 
this input image buffer 18 are arranged. Here, the output of the input image buffer 18 is 
inputted into the field extract section 20, and the output of this field extract section 20 
is inputted into the field buffer 22. The output of the field buffer 22 is inputted into 
average / distribution evaluation section 24 and the pixel restoration section 34. 
Moreover, the arrangement information on the mosaic color on the veneer primary color 
CCD 14 is memorized by the filter arrangement maintenance ROM 26, and the output 
of this filter arrangement maintenance ROM 26 is inputted into the above-mentioned 
average / distribution evaluation section 24 and the parameter calculation section 28. 
The output of the above-mentioned average / distribution evaluation section 24 is 
inputted into the above-mentioned parameter calculation section 28. The output of this 
parameter calculation section 28 is inputted into a parameter buffer 30, and the output 
of this parameter buffer 30 is inputted into the parameter evaluation section 32. The 
output of this parameter evaluation section 32 is outputted to the above-mentioned 
pixel restoration section 34. And the output of this pixel restoration section 34 is 
inputted into the output image buffer 36, and the output of this output image buffer 36 
is drawn in the exterior of the body 12 of a processor concerned. 

[0022] Usually in the exterior of this body 12 of a processor, the color digital image 
which arranges the compression processing section which performs picture compression 
processing of JPEG etc., and storages, such as a memory card, and is outputted from the 
above-mentioned output image buffer 36 is compressed and saved. 

[0023] In addition, although this electronic camera system is considering the electronic 
camera 10 and the body 12 of a processor as another object configuration, it is needless 
to say that an electronic camera 10, the body 12 of a processor, and the compression 
processing section which is not illustrated and a storage may be united with one case at 
drawing 1 as a broken line shows, and you may constitute as electronic camera 
equipment. 

[0024] Next, the actuation in a configuration as shown in drawing 1 is explained. 
[0025] If an image pick-up is performed by the electronic camera 10, the signal from the 
veneer primary color CCD 14 will be digitized through A/D converter 16, and will be 
transmitted to the input image buffer 18 of a body 12 as a digital veneer image. To the 
original RGB image obtained when the same scene is picturized by the 3 plate image 
pick-up system having three kinds of chrominance-signal values,' R, G, and B, in each 
pixel, according to color filter arrangement of the veneer primary color CCD 14, only one 
kind of chrominance -signal value had this digital veneer image in each pixel, but two 
kinds of other chrominance-signal values are missing. So, within a body 12, the 



chrominance -signal value which is missing by each pixel of a digital veneer image is 
presumed, and processing which restores the original RGB image obtained when the 
same scene is picturized by the 3 plate image pick-up system is performed, this 
restoration processing - each pixel of the digital veneer image in the input image buffer 
18 - receiving - one by one - the following processings - ****** - it is attained by 
things. 

[0026] In the following explanation, the pixel set as the object of current restoration 
processing is called an attention pixel. Moreover, the image formed by taking out S 
chrominance -signal value (any of R, G, and B is S?) in each pixel in a field with an 
image will be called S chrominance signal in the field. 

[0027] First, the field extract section 20 writes the image which read the image in the 
field from the sequential input image buffer 18, and read it in the field buffer 22 to all 
the ** type fields with the magnitude containing an attention pixel of 5x5 pixels. After 
the writing of the image in all ** type fields is completed, average / distribution 
evaluation section 24 reads the image in each ** type field to juxtaposition from the 
field buffer 22, and performs the next processing to juxtaposition to each image. 
[0028] That is, average / distribution evaluation section 24 is the average Ar of a 
chrominance-signal value [ in / the pixel location from which R chrominance -signal 
value is acquired in a ** type field is pinpointed from the arrangement information on 
the color filter memorized by the location of the read ** type field, and the filter 
arrangement maintenance ROM 26, and / those pixel locations ]. And distribution Vr It 
calculates. They are the averages Ag and Ab similarly about G and B chrominance 
signal. And Distribution Vg and Vb It calculates. Here, r, g, and b are the subscripts 
showing the class of chrominance signal. And it predicts by the formula (l) as shows 
below the dependability of the parameter computed in the parameter calculation section 
28 from Distribution Vc (any of r, g, and b is c?). Vc Only when filling a ** type (l), 
transmit Ac and Vc (any of r, g, and b is c?) to the parameter calculation section 28. The 
relation of the dependability of a formula (l) and a parameter is mentioned later. 
[0029] 

[Equation l] 

V r >Thl, E/3V g >Thl, fiOV b >Thl, lO 

f "MVr.Vg) > ^^min^.V,) mi n (V g ,V b ) ^| 

[m M (V r) V g ) n» M (V r ,V b ) niWU ma*(V g ,V b ) J 

(1) 

[0030] Here, max (p, q) shows the maximum of p and q, and min (p, q) shows the 



minimum value of p and q. Thl and Th2 are suitable thresholds. 

[0031] At the parameter calculation section 28, they are calculated value Ac and Vc. A 
transfer specifies first the class S of chrominance -signal value which exists in an 
attention pixel (any of R, G, and B is S?) from the arrangement information on a color 
filter and the location of a ** type field which are memorized by the filter arrangement 
maintenance ROM 26. Then, the relation which should consist of the transmitted 
average and distribution in the original RGB image in the ** type field where they were 
computed between a chrominance signal S and other chrominance signals T (that T is 
not [ that ] among [ S ] R, G, and B) is presumed. This relation is called below hue Seki 
of chrominance signals S and T. Hue Seki of the chrominance signals S and T presumed 
is expressed with the following formula (2) containing parameter alphast and betast. 
[0032] 

T=alpha stxS+beta st (2) 

(Any which are r, g, and b in s and the subscript corresponding to S and T in t) 

here, parameter alphast and betast call it a hue Seki parameter - having the average 

Ac And distribution Vc from - it is calculated. 

[0033] Here, hue Seki in a original RGB image and the semantics of a formula (2) are 
described. When the body which generally has a diffuse reflection property under the 
natural lighting environment where the number of dominant illumination light is one is 
picturized, C chrominance-signal value Cp (any of R, G, and B is C?) in the pixel P 
corresponding to the body front face in a original RGB image They are [ spectral 
characteristic / of the dominant illumination light ] Fc, then (any of r, g, and b is c 
(lambda) corresponding to C?) [Equation 2] about the spectral sensitivity characteristic 
of Ref (lambda) and an image sensor in the spectral reflectance on L (lambda) and the 
front face of a body. 

C p = (j L(2)Ref(A)F c (A)cU)x n(P> + J A(A)Ref(A)F c (A)dA (3) 

[0034] It becomes. Among this formula (3), n (P) is an amount decided by the sense of 
the illumination light, and the sense of the normal on the front face of a body 
corresponding to Pixel P, and A (lambda) is the spectral characteristic of the 
illumination light and the ambient light produced as a result of the multiple echo of two 
or more bodies. An integral is taken in the range of wavelength in which the spectral 
sensitivity of an image sensor serves as forward. Let alpha and beta be parameters from 
this formula (3) between the chrominance signal [ / near the pixel P ] C, and C (any of R, 
G, and B is C and C7). C=alphaxC'+beta - (4) 



It turns out that the linearity relational expression to say is realized. 
[0035] Moreover, when a body has a specular reflection property and a diffuse reflection 
property, it is known that the chrominance signal C and C in a field corresponding to 
the front face of the large range of objective have the relation shown by drawing 2 . 
Drawing 2 is that to which C chrominance -signal value was plotted on the axis of 
abscissa, and it plotted C chrominance -signal value on the axis of ordinate about each 
pixel of the original RGB image in the field, and the relation between the chrominance 
signals in a field is illustrated. Hereafter, such a graph is called a hue Seki Fig. 
Although it can consider that the relation between the chrominance signal [ / near / very 
small / the pixel P ] C and C is the thing of this graph which took out the part very 
much here, this can be enough approximated by the formula (4). In the very small image 
field corresponding to the body front face of a single material, the relation between a 
chrominance signal C and C ? can also approximate the basis of the still more 
complicated reflection property of lighting conditions and a body in the straight line of a 
formula (4). This is a reason for using a formula (2) for hue Seki. 

[0036] next, drawing 3 - using - hue Seki parameter alphast and betast -■ calculated 
value Ac and Vc from " how to presume is explained. 

[0037] In the hue Seki Fig. shown in the method of the right in drawing 3 , a thin 
half-tone -dot- meshing part is what illustrated chrominance signals S and T among the 
chrominance signals 38 in a original RGB image, and shows hue Seki of two original 
chrominance signals, however, since the chrominance signal 40 of the veneer image in a 
rectangle field is the Isshiki signal value per pixel, it is expressed with the hatching 
part of the slash of drawing 3 - having the above - only what projected the thin 
half-tone-dot-meshing part on each shaft is obtained. So, with the gestalt of this 
operation, the presumed approximation line 42 which approximates original hue Seki is 
presumed as follows from the slash hatching part of drawing 3 . 

[0038] First, the inclination of the presumed approximation line 42 is presumed as a 
ratio of the amount of fluctuation of each chrominance signal of a veneer image. Next, 
the average of each chrominance signal of a veneer image determines the shunt. If the 
standard deviation (square root of distribution) of each chrominance signal is used as an 
amount of fluctuation, parameter alphast of the presumed approximation line 42 and 
betast will be determined by the following formula (5). 



[0039] 

[Equation 3] 




(5) 



[0040] In addition, they are As, Vs, At, and Vt here. It is an average and distribution of 
the chrominance signals S and T in a rectangle field, a parameter - calculation ■■ the 
section — 28 - the above *■ a formula - (— five ") — being based four - a ** -- a hue - 
Seki a parameter alpha ~ st beta - st alpha - st - ' - beta - st ' (two kinds of 
chrominance signals whose t and t 1 is not s) calculating - as a parameter set - a 
parameter buffer 30 " transmitting . 

[0041] All Ac(s) to which the parameter calculation section 28 was transmitted, and Vc 
After ending the receiving processing, the parameter evaluation section 32 is beginning 
to read at a time one set of parameter sets transmitted to the parameter buffer 30, and 
evaluates the dependability. 

[0042] Here, the importance and the appraisal method of the dependability of a 
parameter are explained. The hue Seki parameter computed based on the 
above-mentioned formula (5) assumes that a formula (2) is realized to hue Seki of the 
chrominance signals S and T in a rectangle field, and is obtained in it. However, as it 
has a different hue and surface brightness is moreover shown to the chrominance signal 
38 of 3 plate images in the hue Seki Fig. shown in the method of the right in drawing 4 
by the boundary section on two front faces of a body which is changing with the 
configurations of a field etc., hue Seki consists of two or more straight lines, and cannot 
be well approximated in a single straight line. This part will be hereafter called the 
color edge field 44, and the part which can approximate hue Seki in a single straight 
line as shown in drawing 3 to this will be called the material homogeneity field 46. 
[0043] In the color edge field 44, since a big presumed error will arise if a lack 
chrominance signal is presumed based on the computed hue Seki parameter, it is 
necessary to avoid use of the hue Seki parameter. However, since a graph like drawing 4 
from the chrominance signal 40 of a veneer image is not obtained, an approximate 
quality will not need to be known directly but will need to presume the dependability. In 
the gestalt of this operation, it is Distribution Vc at average / distribution evaluation 
section 24. The situation that it may be based and dependability may become low first is 
detected, and two steps of processings in which the approximation precision is judged 
based on the value of the hue Seki parameter itself in the parameter evaluation section 
32 are performed. 

[0044] Generally, in the color edge field 44, the inclination for distribution of each 
chrominance signal to become large as compared with the material homogeneity field 46 
is strong. However, in the field of an achromatic color, even if distribution of each 
chrominance signal is large, the straight-line relation between chrominance signals is 



materialized. In average / distribution evaluation section 24, this situation was detected 
and avoided by the formula (l), and it has prevented computing an unreliable hue Seki 
parameter in the parameter calculation section 28. Moreover, the probability for the 
value of Parameter beta to have a big absolute value in the color edge field 44 is high 
about the value of a hue Seki parameter itself. On the other hand, in the material 
homogeneity field 46, Parameter beta takes the value near "0." Also in the material 
homogeneity field 46, although Parameter beta can take a big value on the case where 
the spectral characteristics of ambient light and direct light differ greatly, or the 
outskirts of highlights so that it may be suggested from a formula (3), such fields are 
comparatively few in an image. 

[0045] Then, the parameter evaluation section 32 estimates only the parameter set 
which has I betast I below a threshold for absolute value | betast I of betast in each 
parameter set as compared with the predetermined threshold Th 3 are reliable, and it 
transmits to the pixel restoration section 34. Consequently, as shown in drawing 5 , 
among the parameters which approximate hue Seki in the rectangle field containing the 
attention pixel 48, it removes, the parameter set 52 of the material homogeneity field 46 
is selected, and the parameter set 50 of the color edge field 44 is transmitted to the pixel 
restoration section 34. 

[0046] The pixel restoration section 34 is the chrominance-signal value Sp which exists 
in an attention pixel from the field buffer 22. It reads and the lack chrominance-signal 
value Tp (that T is not [ that ] among [ S ] R, G, and B) in an attention pixel is presumed 
by the following formula (6) to each parameter set alphast and betast which were 
transmitted. 

[0047] Tp =alp hastxSp+ betast - (6) This is illustrated as a process in which the lack 
chrominance signal 56 of an attention pixel is searched for from the chrominance signal 
54 of an attention pixel in drawing 5 . And Tp obtained with each parameter set The 
average is calculated, it considers as the value of the lack chrominance signal of an 
attention pixel, and 3 chrominance -signal value of an attention pixel is generated. 
When a parameter set is not sent at all, the pixel restoration section 34 chooses and 
reads the rectangle field centering on an attention pixel from the field buffer 22, and 
makes the average of the chrominance signal T in the interior the lack 
chrominance-signal value of an attention pixel. 3 chrominance -signal value of an 
attention pixel is written in the location corresponding to the last in the output image 
buffer 36, and the processing to an attention pixel is completed. 

[0048] As a result of performing the processing so far to each pixel, the original RGB 
image with which lack of a chrominance signal was compensated is obtained by the 



output image buffer 36. 

[0049] With the gestalt of this operation, the field extract section 20 chooses two or more 
rectangle fields to each pixel, and two or more estimate of a hue Seki parameter [ / near 
the attention pixel ] is obtained because the parameter calculation section 28 computes 
a hue Seki parameter to each rectangle field. And only what has high dependability is 
selected by average / distribution evaluation section 24 and the parameter evaluation 
section 32 from those estimate, and the lack chrominance-signal value of an attention 
pixel is compensated by the pixel restoration section 34 based on the selected hue Seki 
parameter. Therefore, when the artifact produced in the lack color restoring method 
based on conventional hue Seki in the neighborhood of the color edge field 44 can be 
mitigated and removed and a original RGB image with more high image quality can be 
obtained to the output image buffer 36, high-definition-izing strong against a noise is 
possible by synthesizing the estimate of two or more hue Seki parameters also in the 
material homogeneity field 46. 

[0050] Moreover, since hue Seki is expressed with the formula (2) containing two 
parameters, lack color restoration of a scene with variegated lighting conditions and a 
body surface characteristic can be performed more correctly. 

[0051] Also in presumption of a hue Seki parameter, in order to compute a hue Seki 
parameter from the average of a partial field, and distribution, it has the flexibility 
which can respond to the veneer image pick-up system which has various color filter 
arrangement. 

[0052] Moreover, in the gestalt of this operation, various deformation and modification 
are possible. If the field which the field extract section 20 extracts is small to some 
extent, it is good in the configuration of not only a rectangle field with a size of 5x5 
pixels but the optimal arbitration for mounting, and the field of size. Especially the 
method that determines the field which is mentioned later, and to extract based on the 
characteristic quantity computed from the veneer image as shown in the gestalt of the 
2nd operation is effective. In this case, the field extract section 20 calculates 
characteristic quantity, such as brightness to the whole image, before performing the 
extract about each pixel. And in the extract about each pixel, two or more near is taken 
about each pixel, field division of near each is carried out based on characteristic 
quantity, and each divided field is extracted. 

[0053] Color filter arrangement of the veneer primary color CCD 14 is easy to be the 
thing of arbitration, and a type does not restrict it to a primary color system, either. 
Average / distribution evaluation section 24 may calculate the maximum of each 
chrominance signal in a rectangle field, and the minimum value in addition to an 



average and distribution, it may transmit to the parameter calculation section 28, and 
the parameter calculation section 28 may compute a hue Seki parameter based on the 
maximum and the minimum value which were transmitted. In this case, parameter 
alphast and betast are computed based on the following formulas from maximum 
MAX_c and minimum value MIN_c (any of r, g, and b is c?) of each chrominance signal 
which replaced the formula (5) and were transmitted to it. This approach has quick 
processing speed and is especially effective in a document image etc. [ of processing 
speed ] 
[0054] 

[Equation 4] 

MAX_t - MINt 

" St MAX_s-MIN_s 

n MAX^t + MIN t MAX s + MIN s 

At = - =--«st * ~ =" (7) 

[0055] Moreover, it is also possible to use another formula for the relational expression 

(2) showing hue Seki. For example, only alphast may be calculated according to a 
formula (2) using betast=0 and the set formula by the formula (2). In this case, the 
parameter evaluation section 32 can become unnecessary and processing speed can be 
raised by presuming alphast as a ratio of the average of the chrominance signal on a 
rectangle field, or a mean value. The object picturized is limited, and when the formula 

(3) which is to the base which parameterizes hue Seki can be described in more detail, a 
still more advanced hue Seki model may be adopted. Various deformation can be 
considered also by the final lack chrominance-signal value computing method in the 
pixel restoration section 34. Estimate Tp of the lack chrominance -signal value over each 
parameter set It is also effective to carry out weighting with the dependability of each 
parameter rather than to simply to carry out an arithmetic average. When allowances 
are in the processing time, it considers that each parameter set is a 4-dimensional 
vector, it is clustered, and how to ease the effect of failure in the reliability estimation of 
a parameter by calculating a final lack chrominance -signal value by using the central 
value of the largest cluster for a parameter is also considered. 

[0056] The dependability predicting method of the hue Seki parameter in average / 
distribution evaluation section 24 can also consider various things in addition to a 
formula (l). For example, the approach it is predicted that is unreliable when it is over 
the threshold which takes the difference of distribution of two sorts of chrominance 
signals, and has a difference is more desirable than a formula (l) at a point calculable at 
a high speed. 



[0057] Also about the method of a field extract, two or more [ each time ] fields are not 
extracted per processing of each pixel, but the hue Seki parameter about the rectangle 
field of the predetermined size contained in a veneer image is calculated first, it puts 
into the parameter buffer 30, and improvement in the speed can be attained by making 
it processing in which only what has high dependability is used for lack color restoration 
of each pixel among the hue Seki parameters of the rectangle field containing the pixel. 
[0058] [Gestalt of the 2nd operation] drawing 6 is drawing showing the electronic 
camera structure of a system to which the image processing system concerning the 
gestalt of operation of the 2nd of this invention was applied. In this drawing, the same 
reference number as drawing 1 is given to the same part as the gestalt of the 1st 
operation of the above-mentioned. 

[0059] This electronic camera system consists of bodies 12 of a processor by which cable 
splicing was carried out to the electronic camera 10 and this electronic camera 10. In 
the gestalt of this operation, the input image buffer 18, the reference image count 
section 58, the reference image buffer 60, the block extract section 62, the block division 
section 64, the block buffer 66, average / distribution evaluation section 24a, the filter 
arrangement maintenance ROM 26, parameter calculation section 28a, the block 
restoration section 68, the artifact evaluation section 70, the linear-interpolation section 
72, the addition average section 74, and output image buffer 36a are allotted in a body 
12. 

[0060] Here, the output of the input image buffer 18 is inputted into the reference image 
count section 58, the block extract section 62, and the linear interpolation section 72. 
The output of the reference image count section 58 is inputted into the reference image 
buffer 60, and the output of this reference image buffer 60 is outputted to the block 
division section 64. Moreover, the output of the block extract section 62 is also inputted 
into this block division section 64. The output of the block division section 64 is inputted 
into the block buffer 66, and the output of this block buffer 66 is inputted into average / 
distribution evaluation section 24a and the block restoration section 68. The output of 
the filter arrangement maintenance ROM 26 is also inputted into average / distribution 
evaluation section 24a, and the output of this average / distribution evaluation section 
24a is inputted into parameter calculation section 28a. The output of parameter 
calculation section 28a is inputted into the block restoration section 68, and the output 
of the filter arrangement maintenance ROM 26 is further inputted into this block 
restoration section 68. 

[0061] The output of this block restoration section 68 is inputted into the artifact 
evaluation section 70, and the output of the artifact evaluation section 70 is inputted 



into the addition average section 74. The output of the linear interpolation section 72 
and output image buffer 36a is further inputted into this addition average section 74, 
and the output of this addition average section 74 is inputted into these linear 
interpolation section 72 and output image buffer 36a. Output image buffer 36a holds 3 
color images of the same number of pixels as the image in the input image buffer 18, 
and also is attached to each pixel and holds a counter. This counter is formed in order to 
hold the count by which writing was performed in each pixel location of a buffer. With 
the gestalt of this operation, the estimate of two or more chrominance signals which 
corresponded during processing in each pixel location of the input image buffer 18 is 
calculated, they are integrated to output image buffer 36a, and processing in which an 
addition value is finally equalized in the addition average section 74, and the estimate 
of a final chrominance signal is obtained is performed. It writes in this processing and a 
count is needed. 

[0062] In addition, the output of output image buffer 36a is drawn in the exterior of the 
body 12 of a processor concerned, like the gestalt of the 1st operation of the 
above-mentioned, arranges the compression processing section which performs picture 
compression processing of JPEG etc., and storages, such as a memory card, on the 
exterior of the body 12 of a processor concerned, and compresses and saves outside the 
color digital image outputted from above-mentioned output image buffer 36a. Moreover, 
like the gestalt of the 1st operation of the above-mentioned, as a broken line shows, an 
electronic camera 10, the body 12 of a processor, and the compression processing section 
which is not illustrated and a storage may be united with one case at drawing 6 , and of 
course, you may constitute as electronic camera equipment. 

[0063] Next, the actuation in a configuration as shown in drawing 6 is explained. 
[0064] If an image pick-up is performed by the electronic camera 10, the signal from the 
veneer primary color CCD 14 will be digitized through A/D converter 16, and will be 
transmitted to the input image buffer 18 of a body 12 as a digital veneer image. To the 
original RGB image obtained when the same scene is picturized by the 3 plate image 
pick-up system having three kinds of chrominance -signal values, R, G, and B, in each 
pixel, according to color filter arrangement of the veneer primary color CCD 14, only one 
kind of chrominance-signal value had this digital veneer image in each pixel, but two 
kinds of other chrominance -signal values are missing. So, within a body 12, the 
chrominance -signal value which is missing by each pixel of a digital veneer image is 
presumed, and processing which restores the original RGB image obtained when the 
same scene is picturized by the 3 plate image pick-up system is performed, this 
restoration processing - the digital veneer image in the input image buffer 18 - 



receiving - the following processings " ****** it is attained by things. 

[0065] After a transfer of the image from an electronic camera 10 to a body 12 is 

completed, first, the reference image count section 58 covers a 3x3-pixel low pass filter 

with the multiplier of a formula (8) shown in the digital" veneer image in the input 

image buffer 18 below, and writes a result in the reference image buffer 60 as a 

reference image. 

[0066] 

0.0625 0.125 0.0625 0.125 0.25 0.125 - (8) 

0.0625 0.125 The image calculated with the direct low pass filter from 0.0625, thus a 
veneer image is reflecting the low-pass component of brightness component 
0.25R+0.5G+0.25B of the original RGB image corresponding to a veneer image. 
[0067] Next, the pixel value and counter of each pixel in output image buffer 36a are 
initialized by M 0", and the next processing is performed to the rectangle field of all 5x 
5-pixel sizes contained in the digital veneer image in the input image buffer 18. The 
image formed by taking out S chrominance-signal value (any of R, G, and B is S?) in 
each pixel in a field with an image hereafter will be called S chrominance signal in the 
field. 

[0068] the block extract section 62 from the upper left corner of the digital veneer 
image in the input image buffer 18 - first - the right - subsequently 1 pixel of locations 
of a rectangle field is shifted at a time downward, and the image in a rectangle field is 
read one by one. It is read by the block extract section 62 and the image with which 
processing started is called an attention block. The following processings differ for a 
while by whether an attention block belongs to the color edge field 44, or it belongs to 
the material homogeneity field 46, and drawing 7 shows the processing to the color edge 
field 44, and processing of as opposed to the material homogeneity field 46 in drawing 8 . 
[0069] Hereafter, explanation of processing is mainly given based on drawing 7 . The 
attention block 76 is first transmitted to the block division section 64. The block division 
section 64 reads the part reference image 78 corresponding to the rectangle field of an 
attention block from the reference image in the reference image buffer 60, and 
calculates Maximum RefMAX and the minimum value RefMIN in the part reference 
image 78. And the binarization image 80 which has a pixel value "1" or "0" by making 
(RefMAX+RefMIN)/2 into a threshold from the part reference image 78 is generated. 
-Next, block A corresponding to the field which divides the attention block 76 into two 
and has a pixel value "1" on the binarization image 80 Block B corresponding to 82 and 
the field which has a pixel value "0" on a binarization image 84 is generated. And block 
A 82 and block B 84 is written in the block buffer 66. 



[0070] As mentioned above, the part reference image 78 which are some reference 
images is equivalent to the brightness component of a original RGB image. Therefore, 
the edge structure of a original RGB image is reflected in the binarization image 80 of 
the part reference image 78, and it is Block A. 82 Block B 84 corresponds to the field of 
right and left of an edge. In the color edge field 44 shown in drawing 4 used in 
explanation of the gestalt of the 1st operation, right and left of an edge are the material 
homogeneity field 46, and correspond to the straight-line part contained in the 
chrominance signal 38 of a original RGB image. Therefore, it is Block A, even when the 
attention block belongs to the color edge field 44 and the hue Seki parameter within a 
block cannot presume correctly. 82 Block B Within 84, the probability for hue Seki to be 
able to approximate in a straight line, and for a hue Seki parameter to be called for 
correctly is high. 

[0071] When two images are written in the block buffer 66, average / distribution 
evaluation section 24a reads the arrangement information on the color filter memorized 
by the filter arrangement maintenance ROM 26, and is Block A. 82 Block B The location 
where chrominance signals R, G, and B are acquired in 84 each, respectively is 
pinpointed, and block A 82 and B (B) [ any of R, G, and B, or C ] The number Nc of the 
chrominance signal C acquired in the interior about 84 each (A) and Nc (B) and the 
average Ac (A) and Ac (B) and distribution Vc (A) and Vc the subscript in which c 
expresses the class of chrominance signal C with any of r, g, and b they are - it is - it 
calculates. From these values to furthermore, the block A 82 Block B The average Ac 
about the attention block 76 whole which compounded 84 (Merge) (M) and distribution 
Vc (M) is calculated by the following formula (9). 
[0072] 

[Equation 5] 

v (M>= N c (A)xVc(A)4.N c (B)xV c (B)-hN c (A)xN c (B)x(A c (A)-Ac(B)) 2 

N C (A) + N C (B) 

N c (A)xA c (A) + N c (B)xA c (B) 
Ac(M) " N C (A) + N C (B) 

-.(9) 

[0073] And these averages and distributions are transmitted to parameter calculation 
-section 28a. Hereafter, the amount is Block A when the alphabetic character in a 
parenthesis is M. 82 and B When it is shown that it is an amount about the whole 
attention block with which 84 was compounded and an alphabetic character expresses A 
thru/or B, it is shown that it is an amount about the block with which the amount 



corresponds. 

[0074] The average value transmitted in parameter calculation section 28a and the 
attention block 76 from distribution, block A 82 and block B The hue Seki parameter in 
84 is computed. Each block A 82 B In the 84 and attention block 76 whole, the following 
formula (10) is assumed among chrominance signals S and T like the formula (2) in the 
gestaltofthe 1st operation. 
[0075] 

T=alpha st(X) x S+beta st (X) - (10) 

And a hue Seki parameter is calculated by the following formula (ll) like a formula (5). 
In addition, in this formula (10) and (11), S differs from T mutually by any of R, G, and 
B they are. Moreover, s and t are the subscripts corresponding to S and T, respectively, 
and X is in any of A, B, and M. 
[0076] 

[Equation 6] 



[0077] And parameter calculation section 28a is Block A. 82 and block B The hue Seki 
parameter of 84 is compared, and when not exceeding the threshold which has those 
differences about the combination of all chrominance signals, hue Seki parameter 
alphast (M) and betast (M) are transmitted to the block restoration section 68. Total 
Nr(X)+Ng of the number of the chrominance signal in a block when that is not right 
(X)+Nb (X) transmits hue Seki parameter alphast (X) about the block X of more ones 
(any of A and B is X?), and betast (X) to the block restoration section 68. 
[0078] Here, with reference to drawing 7 and drawing 8 , the hue Seki parameter 
transmitted from parameter calculation section 28a is explained. When an attention 
block belongs to the color edge field 44 like the attention block 76 of drawing 7 , the 
dependability of the hue Seki parameter of the block after division improves by 
performing block division based on the part reference image 78 which is a brightness 
component, however, an attention block the attention block 86 of drawing 8 - when it 
belongs to the material homogeneity field 46 like, the hue Seki parameter to the whole 
attention block can already compute with high dependability. On the contrary, it is 
Block A when a block is divided by the part reference image 88. 90 Block B In 92, since 
there are few pixels, the dependability of a hue Seki parameter falls on the contrary. 
Then, parameter calculation section 28a compares the hue Seki parameter of the block 
after division, and when similar, it computes anew the hue Seki parameter about the 




whole attention block. 

[0079] In the block restoration section 68, the following processings are performed 
according to the class of transmitted hue Seki parameter alphast and betast. When the 
transmitted hue Seki parameters are alphast (M) and betast (M), both two blocks are 
read from the block buffer 66. On the other hand, if a hue Seki parameter is related with 
block [ which ], the block which corresponds from the block buffer 66 will be read. And 
the class S of chrominance -signal value which exists in the pixel (any of R, G, and B is 
S?) is specified about each pixel of the read image from the color filter arrangement 
information in which it is stored by the filter arrangement maintenance ROM 26. The 
chrominance -signal value Sp The chrominance -signal value Tp (class in which T differs 
from S) which is missing from the transmitted hue Seki parameter is calculated from a 
formula (6) like the gestalt of the 1st operation. And the restoration block of a color with 
which lack of all the chrominance signals within the block relevant to the transmitted 
hue Seki parameter is compensated, and 3 chrominance -signal value exists in each pixel 
is generated. In the case of others, the restoration block 94 with which lack of the 
chrominance signal of the attention block 86 whole was restored when the transmitted 
hue Seki parameters were alphast (M) and betast (M) is Block A. 82 Block B The 
restoration block 96 which receives any of 84 they are will be generated. A restoration 
block is transmitted to the artifact evaluation section 70, and it is judged whether the 
artifact is contained in the restoration result. 

[0080] In the pixel location where the color filter of a specific class exists, a value which 
the chrominance-signal value is as large as a surrounding chrominance -signal value, 
and is different is shown by the artifact generated in the color edge field 44. The artifact 
evaluation section 70 detects and evaluates as follows this artifact contained in a 
restoration block. 

[0081] Detection is performed about each chrominance signal S (any of R, G, and B is 
S?). First, they are a chrominance-signal value in the about 3x3 pixels, and the 
chrominance-signal value Sp of Pixel P about each pixel P of a restoration block. It 
compares and is the chrominance -signal value Sp. It investigates whether it will become 
inner max or min soon. Next, when it is max or min, it is the average Ap s of the 
chrominance signal in about 3x3 pixels. And standard deviation sigmap s (subscript 
corresponding to S in s) is calculated, and it investigates whether the value of Pixel P 
satisfies the following formula (12) to the predetermined constant k. 
[0082] 

Sp <Ap s-kxsigma p s Or Sp >Ap s+ kxsigma p s - (12) 

The pixel with which were satisfied of the formula (12) is judged to be an artifact 



generating pixel. When the total of the detected artifact generating pixel is less than the 
predetermined threshold after investigating all chrominance signals in this way, it 
judges that the artifact is not contained in a restoration block, and a restoration block is 
transmitted to the addition average section 74. When that is not right, it considers that 
the artifact is contained in a restoration block, and a transfer is not performed. 
[0083] The addition average section 74 performs the following processings, only when a 
restoration block is transmitted from the artifact evaluation section 70. 
[0084] First, a restoration block is read from the block restoration section 68. And in 
each pixel P of a restoration block, the chrominance-signal value in the pixel P of the 
restoration block 96 is added to the addition value of the location corresponding to the 
pixel P in output image buffer 36a. "1" And increase the counter corresponding to the 
pixel P in output image buffer 36a. 

[0085] After the above processing is performed to the rectangle field of all the 5x5-pixel 
sizes contained in the digital veneer image in the input image buffer 18, the addition 
average section 74 reads the addition value and counter of each pixel P in output image 
buffer 36a, and performs the following processings. 

[0086] First, when a counter is "0", the linear interpolation section 72 is told about the - 
location of Pixel P. The linear interpolation section 72 reads the 3x3-pixel field centering 
on Pixel P from the input image buffer 18, the chrominance signal which exists in Pixel 
P is used as it is, and a missing chrominance -signal value will be compensated with the 
average of an inner of-the-same-kind chrominance -signal value soon, and will generate 
3 chrominance-signal value of a pixel. And the 3 chrominance -signal value is 
transmitted to the addition average section 74. The addition average section 74 writes 
the transmitted restoration value in output image buffer 36a. When a counter is not "0", 
the addition average section 74 acquires the average value of two or more restoration 
values which broke the addition value by the counter and were acquired during 
processing, and writes this value in output image buffer 36a. Termination of the 
processing so far obtains the original RGB image with which lack of a chrominance 
signal was compensated by output image buffer 36a. 

[0087] With the gestalt of this operation, it reads the block extract section 62 shifting a 
rectangle field from the digital veneer image in the input image buffer 18, and as a 
result of the block division section's 64 dividing a block into the material homogeneity 
field 46 based on the reference image calculated by the reference image count section 58 
from the veneer image, parameter calculation section 28a can compute a reliable hue 
Seki parameter about the divided block. And the block restoration section 68 restores all 
the lack chrominance signals of a block based on a hue Seki parameter, and generates a 



restoration block. In integrating to output image buffer 36a, the addition average 
section 74 only the restoration block with which an artifact is not contained based on 
evaluation of the artifact evaluation section 70 The lack restoration value using the hue 
Seki parameter about two or more material homogeneity fields 46 which include the 
pixel in each pixel of output image buffer 36a is acquired. With the lack restoration 
value which synthesized them and was finally calculated being integrated and 
equalized, and being outputted to output image buffer 36a The artifact produced in the 
lack color restoring method based on conventional hue Seki in the neighborhood of the 
color edge section can be mitigated and removed, and a original RGB image with more 
high image quality can be obtained to output image buffer 36a. Moreover, since the 
configuration of the field which computes a hue Seki parameter by performing field 
division other than the same improvement effectiveness in image quality as the thing in 
the gestalt of operation of these 1st becomes adjustable, a hue Seki parameter is 
calculated more correctly and it is effective in being easy to realize improvement in 
image quality to a complicated scene. Furthermore, it also has the effectiveness that 
more positive artifact removal can be performed by carrying out the direct valuation of 
the artifact of a restoration block. 

[0088] Moreover, in the gestalt of this operation, various deformation and modification 
are possible like the gestalt of the 1st operation of the above-mentioned. All deformation 
indicated in the gestalt of the 1st operation is possible for the computing method in the 
color filter array of the magnitude of a block, and the veneer primary color CCD 14 and 
parameter calculation section 28a which the block extract section 62 extracts. Moreover, 
before computing a hue Seki parameter in average / distribution evaluation section 24a 
like the gestalt of the 1st operation, the dependability is predicted, and when unreliable, 
it can avoid performing processing after it. 

[0089] After the reference image count section 58 carries out linear interpolation of the 
veneer image, the reference image calculated by the reference image count section 58 
computes a color difference component, and is [ that what is necessary is just that in 
which the difference in the pixel value reflects the difference in the hue Seki parameter 
in a original RGB image ] good also as a reference image. The artifact appraisal method 
in the artifact evaluation section 70 is also arbitrary if a pixel with a 
chrominance-signal value which is different specially from a surrounding pixel is 
detected. For example, an edge detection filter may be covered over a restoration block, 
and may be judged from the pattern of the output. 

[0090] Of course, not only binarization but the various labeling technique can also apply 
the field split plot experiment in the block division section. If a limit is prepared in field 



division so that a hue Seki parameter can presume with high dependability on the 
divided field, it is much more effective for oppression of a false color. 
[0091] [Gestalt of the 3rd operation] drawing 9 is drawing showing the electronic 
camera structure of a system to which the image processing system concerning the 
gestalt of operation of the 3rd of this invention was applied. In this drawing, the same 
reference number as drawing 1 and drawing 6 is given to the same part as the gestalt of 
the above-mentioned 1st and the 2nd operation. 

[0092] This electronic camera system consists of bodies 12 of a processor by which cable 
splicing was carried out to the electronic camera 10 and this electronic camera 10. It is 
GCCD which the electronic camera 10 had a 2 plate type image pick-up system in the 
gestalt of this operation, and arranged G filter on all pixels in the interior. 141 And R/B 
check CCD which arranged R filter and B filter in checkers for every pixel 142 It is 
constituted so that it may be inputted into the input image buffer 18 within the body 12 
of a processor with which the cable splicing of the output was carried out through A/D 
converter 16. On the other hand, in the body 12 of a processor, the block extract section 
62, the block buffer 66, average / distribution evaluation section 24b, parameter 
calculation section 28b, parameter evaluation section 32b, block restoration section 68b, 
the addition average section 74, the linear interpolation section 72, and output image 
buffer 36a are allotted. 

[0093] Here, the output of the input image buffer 18 is inputted into the block extract 
section 62 and the linear interpolation section 72. The output of the block extract 
section 62 is inputted into the block buffer 66, and the output of this block buffer 66 is 
inputted into average / distribution evaluation section 24b, parameter evaluation 
section 32b, and block restoration section 68b. The output of average / distribution 
evaluation section 24b is inputted into parameter calculation section 28b, and the 
output of this parameter calculation section 28b is inputted into parameter evaluation 
section 32b. The output of parameter evaluation section 32b is inputted into block 
restoration section 68b, and the output of this block restoration section 68b is inputted 
into the addition average section 74. 

[0094] The output of the linear interpolation section 72 and output image buffer 36a is 
further inputted into this addition average section 74, and the output of this addition 
average section 74 is inputted into these linear interpolation section 72 and output 
image buffer 36a. Output image buffer 36a holds 3 color images of the same number of 
pixels as the image in the input image buffer 18, and also holds a counter to each pixel. 
This counter is formed in order to hold the count by which writing was performed in 
each pixel location of a buffer. With the gestalt of this operation, two or more 



chrominance -signal estimate corresponding to each pixel of the input image buffer 18 is 
calculated during processing, they are integrated to output image buffer 36a, and 
processing in which final chrominance-signal estimate is obtained by finally an addition 
value being equalized in the addition average section 74 is performed. It writes in this 
processing and a count is needed. 

[0095] In addition, the output of output image buffer 36a is drawn in the exterior of the 
body 12 of a processor concerned, like the gestalt of the 1st operation of the 
above-mentioned, arranges the compression processing section which performs picture 
compression processing of JPEG etc., and storages, such as a memory card, on the 
exterior of the body 12 of a processor concerned, and compresses and saves outside the 
color digital image outputted from above-mentioned output image buffer 36a. Moreover, 
like the gestalt of the 1st operation of the above-mentioned, as a broken line shows, an 
electronic camera 10, the body 12 of a processor, and the compression processing section 
which is not illustrated and a storage may be united with one case at drawing 9 , and of 
course, you may constitute as electronic camera equipment. 

[0096] Next, the actuation in a configuration as shown in drawing 9 is explained. 
[0097] if an image pick-up is performed by the electronic camera 10 - GCCD 141 And 
R/B check CCD 142 from - a signal should pass A/D converter 16 - it is digitized and is 
transmitted to the input image buffer 18 of a body 12 as a digital 2 plate image. This 
digital 2 plate image is the R/B check CCD to each pixel to the original RGB image 
obtained when the same scene is picturized by the 3 plate image pick-up system having 
three kinds of chrominance -signal values, R, G, and B, in each pixel. 142 Having [ but ] 
only two kinds of chrominance -signal values of G, R, or G and B according to color filter 
arrangement, one kind of other chrominance-signal values are missing. So, within a 
body 12, the chrominance -signal value which is missing by each pixel of the digital 
image in the input image buffer 18 is presumed, and processing which restores the 
original RGB image obtained when the same scene is picturized by the 3 plate image 
pick-up system is performed, this restoration processing -- the digital 2 plate image in 
the input image buffer 18 - receiving -- one by one - the following processings -- ****** 
-- it is attained by things. 

[0098] That is, after a transfer of the image from an electronic camera 10 to a body 12 is 
completed, first, the pixel value and counter of each pixel in output image buffer 36a are 
initialized by "0", and the following processings are performed to the rectangle field of 
all 5x 5-pixel sizes contained in the digital 2 plate image in the input image buffer 18. 
The image formed by taking out S chrominance -signal value (any of R, G, and B is S?) in 
each pixel in a field with an image hereafter will be called S chrominance signal in the 



field. 

[0099] the block extract section 62 - from the upper left corner of the digital image in 
the input image buffer 18 first " the right - subsequently 1 pixel of locations of a 
rectangle field is shifted at a time downward, and the image in a rectangle field is read 
one by one. It is read by the block extract section 62 and the image with which 
processing started is called an attention block. The read attention block is transmitted 
to the block buffer 66. 

[0100] Then, average / distribution evaluation section 24b is the average Ag of G 
chrominance signal which reads an attention block from the block buffer 66, and exists 
in all pixels. And distribution Vg It calculates. Next, it is the R/B check CCD about the 
class (any of R and B are they?) of chrominance-signal value which exists in each pixel 
of an attention block. 142 It calculates using the regularity of color filter arrangement. 
And the average Ar of R chrominance signal within an attention block Distribution Vr 
and the average Ab of B chrominance signal Distribution Vb It computes, (r, g, and b are 
the subscripts showing the class of chrominance signal) And the average Ac And 
Distribution Vc (any of r, g, and b is c?) is transmitted to parameter calculation section 
28b. 

[0101] The average Ac transmitted in parameter calculation section 28b And 
distribution Vc It is based and the following processings are performed. First, 
distribution Vg of G chrominance signal In beyond a threshold, as compared with a 
predetermined threshold, it calculates by the above-mentioned formula (5) which 
explained hue Seki parameter alphagr, betagr and alphagb, and betagb with the gestalt 
of the 1st operation of the above-mentioned. On the other hand, it is Vg. When it is 
below a threshold, similarly hue Seki parameter alphabr, betabr and alpharb, and 
betarb are calculated by the above-mentioned formula (5). And the calculated hue Seki 
parameter is transmitted to parameter evaluation section 32b. 

[0102] Parameter evaluation section 32b estimates the dependability of the transmitted 
parameter as follows. First, when the transmitted parameters are alphagr, betagr and 
alphagb, and betagb, an attention block is read from the block buffer 66. And it sets to 
each pixel P of an attention block, and is the R/B check CCD. 142 Chrominance signals 
T other than G which exists in Pixel P using the regularity of color filter arrangement 
(any of R and B is T?) are specified. The chrominance-signal value Tp The presumed 
error of chrominance-signal estimate with the hue Seki parameter from G 
chrominance -signal value Gp and hue Seki parameter alphagt, and betagt (any of r and 
b is t corresponding to T?), and an actual chrominance -signal value ep =Tp- 
(alphagtxGp+betagt) - (13) 



It calculates. Next, when total of the absolute value of the error in all the pixels within 
an attention block is calculated and total is not over the predetermined threshold, it 
judges that the dependability of hue Seki parameter alphagr, betagr and alphagb, and 
betagb is high, and hue Seki parameter alphagr, betagr and alphagb, and betagb are 
transmitted to block restoration section 68b. 

[0103] Drawing 10 is Error ep to an example about the pixel p from which R 
chrominance signal is acquired in the color edge field 44. Semantics is illustrated. Since 
two kinds of chrominance signals are acquired by each pixel in a 2 plate image pick-up 
system, it is possible to illustrate a hue Seki Fig. partially as shown as a chrominance 
signal 98 of 2 plate images in drawing 10 . Error ep The difference of R 
chrominance- signal estimate 102 presumed from G chrominance-signal value 100 based 
on the presumed approximation line 42 with which it is expressed by hue Seki 
parameter alphagr and betagr, and actual R chrominance -signal value 104 is expressed, 
and the dependability which approximates hue Seki by the presumed approximation 
line 42 becomes so large that it is bad. 

[0104] When the transmitted hue Seki parameters are alphabr, betabr and alpharb, and 
betarb on the other hand, When it investigates whether absolute value | betabr | of 
parameter betabr and absolute value | betarb | of betarb exceed a predetermined 
threshold and is over neither It judges that the dependability of hue Seki parameter 
alphabr, betabr and alpharb, and betarb is high, and hue Seki parameter alphabr, 
betabr and alpharb, and betarb are transmitted to block restoration section 68b. 
[0105] Block restoration section 68b is the R/B check CCD about the class T of 
chrominance signal which reads an attention block from the block buffer 66, and is 
missing by each pixel p of an attention block when a hue Seki parameter is transmitted 
from parameter evaluation section 32b (any of R and B is T?). 142 It specifies based on 
the regularity of a color filter array, and the case where the transmitted parameters are 
alphagr, betagr and alphagb, and betagb G chrominance -signal value Gp of each pixel 
P within an attention block from chrominance-signal value Tp which is missing by 
each pixel It presumes by the following formulas. 
[0106] 

Tp =alphagtxGp+betagt - (14) 

Moreover, chrominance-signal value Tp which is missing by each pixel from the 
chrominance -signal value Sp which exists in each pixel P within an attention block in 
addition to G chrominance signal when hue Seki parameter alphabr from parameter 
evaluation section 32b, betabr and alpharb, and betarb are transmitted (that S is not 
[ that ] among [ T ] R and B) It presumes by the following formulas. 



[0107] 

Tp =alphastxSp+betast - (15) 

And the restoration block have 3 chrominance-signal value in each pixel in any case of 
whose is generated. In this way, the generated restoration block is transmitted to the 
addition average section 74. On the other hand, when a hue Seki parameter is not 
transmitted from parameter evaluation section 32b, neither generation of a restoration 
block nor a transfer is performed. 

[0108] The addition average section 74 adds the chrominance -signal value in the pixel P 
of a restoration block to the addition value of the location corresponding to the pixel P in 
output image buffer 36a to each pixel P of a restoration block, only when a restoration 
block is transmitted from block restoration section 68b. "1" And increase the counter 
corresponding to the pixel P in output image buffer 36a. 

[0109] After the above processing is performed to the rectangle field of all the 5x5-pixel 
sizes contained in the digital 2 plate image in the input image buffer 18, the addition 
average section 74 reads the addition value and counter of each pixel P in output image 
buffer 36a, and performs the following processings. 

[0110] First, when a counter is "0", the linear interpolation section 72 is told about the 
location of Pixel P. The linear interpolation section 72 reads the 3x3-pixel field centering 
on Pixel P from the input image buffer 18, the chrominance -signal value which exists in 
Pixel P is used as it is, and a missing chrominance-signal value will be compensated 
with the average of an inner chrominance -signal value of the same kind soon, and will 
generate 3 chrominance-signal value of a pixel. And the 3 chrominance -signal value is 
transmitted to the addition average section 74. The addition average section 74 writes 
the transmitted restoration value in output image buffer 36a. When a counter is not "0", 
the addition average section 74 acquires the average value of two or more restoration 
values which broke the addition value by the counter and were acquired during 
processing, and writes this value in output image buffer 36a. 

[01 11] Termination of the processing so far obtains the original RGB image with which 
lack of a chrominance signal was compensated by output image buffer 36a. 
[0112] As mentioned above, with the gestalt of this operation, it reads the block extract 
section 62 shifting a rectangle field from the digital 2 plate image in the input image 
buffer 18, and parameter calculation section 28b computes a hue Seki parameter. Next, 
parameter evaluation section 32b judges the dependability of a hue Seki parameter by 
calculating the restoration error of a chrominance signal from two kinds of 
chrominance-signal values which exist in each pixel of 2 plate images, and transmits 
only a reliable parameter to block restoration section 68b. And block restoration section 



68b restores all the lack chrominance signals of a block based on a hue Seki parameter, 
a restoration block is generated, and the addition value of two or more lack restoration 
values calculated only based on the reliable hue Seki parameter in each pixel of output 
image buffer 36a in the addition average section 74 integrating a restoration block to 
output image buffer 36a is acquired. With finally those average values being outputted 
to output image buffer 36a, the artifact produced as well as the gestalt of the 1st 
operation of the above-mentioned in the neighborhood of the color edge section can 
obtain few high original RGB images of image quality to output image buffer 36a. With 
the gestalt of this operation, it is possible to suppress generating of an artifact still more 
effectively than the case in the gestalt of the 1st operation by evaluating the 
dependability of a hue Seki parameter certainly using input images being 2 plate 
images. Moreover, by changing which [ of two kinds of chrominance signals acquired by 
each pixel according to local distribution of G chrominance signal ] is used for lack color 
restoration, also when G signal tends to be small influenced of a noise by the restoration 
only from G signal, a good restoration result can be maintained. 

[0113] In addition, in the gestalt of this operation, various deformation and modification 
are possible like the gestalt of the 1st operation. Magnitude of the block extracted by the 
block extract section 62, R/B check CCD 142 All deformation indicated in the gestalt of 
the 1st operation is possible for a color filter array or the computing method in 
parameter calculation section 28b. 

[0114] For example, it is possible for it to predict the dependability of a hue Seki 
parameter based on the value of an average and distribution in average / distribution 
evaluation section 24b, and for it to be made not to perform processing after it as well as 
the gestalt of the 1st operation, when unreliable. Moreover, in the case of a 2 plate 
image pick-up system, since it is possible to constitute the hue Seki Fig. within an 
attention block, various approaches can be considered also to the calculus of the 
dependability of a hue Seki parameter. For example, it applies from the case where 
applied two straight lines to the hue Seki Fig., and a single straight line is applied, and 
when there are few errors, it can also be judged that the dependability of a hue Seki 
parameter is low. Furthermore, it also becomes easy to perform field division like the 
gestalt of the 2nd operation, and to raise the dependability of a parameter. In this case, 
average / distribution evaluation section 24b is a hue Seki Fig. to Hough. What is 
necessary is to extract a straight line using the straight-line extract technique, such as 
conversion, and just to let the fields corresponding to a good, most applied bay be the 
following processing objects. It is the presumed error ep computed in each pixel P within 
an attention block as a easier field split plot experiment by parameter evaluation 



section 32b. An attention block is divided into two regional blocks according to a sign, it 
returns to the block buffer 66, and what perforins parameter calculation by parameter 
calculation section 28b anew by each regional block, and uses a reliable regional block 
for future processings is mentioned. Moreover, even when performing field division 
based on characteristic quantity like the gestalt of the 2nd operation, if G component 
which exists in all pixels as characteristic quantity is used, more exact lack color 
restoration will be attained. 

[0115] Various deformation is possible also to the addition average section 74 or the 
approach in block restoration section 68b. From the first, since G chrominance signal is 
acquired without lack, it is not necessary to perform addition about G chrominance 
signal. Moreover, although the reliability evaluation of the hue Seki parameter of R and 
G and the hue Seki parameter of B and G is put in block and performed in parameter 
evaluation section 32b If error evaluation is carried out separately, respectively and a 
transfer of the hue Seki parameter to block restoration section 68b is also performed 
independently, although hue Seki of R and G can approximate in a straight line, lack 
restoration of B chrominance signal will be attained also in the case of being unable to 
approximate hue Seki of B and G. 

[0116] Although this invention was explained based on the gestalt of operation above, 
this invention is not limited to the gestalt of operation mentioned above, and 
deformation and application various by within the limits of the summary of this 
invention are possible for it. Here, it is as follows when the summary of this invention is 
summarized. 

[0117] (l) Input the digital image which was obtained by the veneer image pick-up 
system or the 2 plate image pick-up system and which lacks one or more kinds of 
chrominance-signal values about each pixel. In the image processing system which 
presumes the lack chrominance-signal value of each pixel, and outputs a color digital 
image A field extract means to extract the image field in which plurality is different 
from each other per each pixel from the digital image which lacks the above-mentioned 
chrominance-signal value, A hue Seki parameter estimation means to presume the hue 
Seki parameter showing hue Seki on the image field based on the chrominance -signal 
value which exists on the image field to each image field extracted by the 
above-mentioned field extract means, The dependability of each hue Seki parameter 
presumed by the above-mentioned hue Seki parameter estimation means is evaluated 
based on the chrominance-signal value on the image field corresponding to the hue Seki 
parameter and its hue Seki parameter. A parameter selection means to select only a 
reliable hue Seki parameter, As opposed to each pixel of the digital image which lacks 



the above-mentioned chrominance-signal value The image processing system 
characterized by providing a restoration means to restore the lack chrominance-signal 
value of the pixel based on the chrominance -signal value which exists in the pixel, and 
the thing in which the image field which corresponds among the hue Seki parameters 
selected by the above-mentioned hue Seki parameter selection means includes the pixel. 
[0118] Two, the gestalt of the 1st operation and the gestalt of the 3rd operation shown in 
a list at drawing 9 and drawing 10 this configuration is indicated to be to drawing 1 
thru/or drawing 5 , correspond. That is, a field extract means corresponds to the field 
extract section 20 with the gestalt of the 1st operation, and corresponds to the block 
extract section 62 with the gestalt of the 3rd operation. A hue Seki parameter 
estimation means corresponds to average / distribution evaluation sections 24 and 24b 
and the parameter calculation sections 28 and 28b. A parameter selection means 
corresponds to the parameter evaluation sections 32 and 32b. A restoration means 
corresponds to the pixel restoration section 34 with the gestalt of the 1st operation, and 
corresponds to block restoration section 68b and the addition average section 74 with 
the gestalt of the 3rd operation. 

[0119] According to the above configurations, a field extract means extracts two or more 
image fields per each pixel of an input image, and a hue Seki parameter estimation 
means presumes and parameterizes hue Seki on an image field to each extracted image 
field. And a parameter selection means evaluates the dependability of each parameter 
presumed by the hue Seki parameter estimation means, and sends only a reliable 
parameter to a restoration means. With a restoration means, the chrominance -signal 
value of the pixel is restored in each pixel of an input image based on the thing relevant 
to the pixel among the sent parameters. 

[0120] Therefore, since two or more image fields are taken to each pixel of an input 
image and only what has high dependability is selected among the hue Seki parameters 
on each image field, the artifact produced by using an unreliable parameter can be 
controlled. Moreover, since restoration of the lack chrominance-signal value of each 
pixel is performed from two or more hue Seki parameters in relation to the pixel, 
restoration strong against a noise is attained. 

[0121] (2) Input the digital image which was obtained by the veneer image pick-up 
system or the 2 plate image pick-up system and which lacks one or more kinds of 
chrominance-signal values about each pixel. In the image processing system which 
presumes the lack chrominance-signal value of each pixel, and outputs a color digital 
image A field extract means to extract the image field in which plurality is different 
from each other per each pixel from the digital image which lacks the above-mentioned 



chrominance-signal value, A hue Seki parameter estimation means to presume the hue 
Seki parameter showing hue Seki on the image field based on the chrominance -signal 
value which exists on the image field to each image field extracted by the 
above-mentioned field extract means, A field restoration" means to restore the lack 
chrominance -signal value on each image field from the hue Seki parameter 
corresponding to the image field, and the chrominance -signal value which exists in each 
pixel, and to generate a restoration image field, A restoration field selection means to 
select the restoration image field which evaluated the dependability of a restoration 
result based on the chrominance -signal value on the restoration image field, and was 
estimated to be reliable to each restoration image field generated by the 
above-mentioned field restoration means, The image processing system characterized 
by providing a pixel restoration means to restore the lack chrominance-signal value of 
the pixel based on what contains the pixel among the restoration image fields selected 
by the above-mentioned restoration field selection means, to each pixel of the digital 
image which lacks the above-mentioned chrominance -signal value. 

[0122] The gestalt of the 2nd operation this configuration is indicated to be to drawing 6 
thru/or drawing 8 corresponds. That is, a field extract means corresponds to the 
reference image count section 58, the reference image buffer 60, the block extract 
section 62, and the block division section 64. A hue Seki parameter estimation means 
corresponds to average / distribution evaluation section 24a and parameter calculation 
section 28a. A field restoration means corresponds to the block restoration section 68, 
and a restoration field selection means corresponds to the artifact evaluation section 70. 
And a pixel restoration means corresponds to the addition average section 74. 
[0123] According to the above configurations, a field extract means extracts two or more 
image fields per each pixel of an input image, and a hue Seki parameter estimation 
means presumes and parameterizes hue Seki on an image field to each extracted image 
field. And the lack chrominance-signal value in each pixel on the image field where a 
field restoration means corresponds per [ which was presumed ] each parameter is 
restored, and the restoration image field of a color is generated. This processing is 
performed based on each hue Seki parameter and the chrominance -signal value which 
already exists on a corresponding image field. If lessons is taken from each hue Seki 
parameter and a restoration image field is generated in this way, a restoration field 
selection means will select only the restoration image field which evaluated the 
dependability of a restoration result based on the chrominance -signal value on each 
restoration image field, and was estimated to be reliable. With a pixel restoration 
means, the chrominance -signal value of the pixel is restored in each pixel of an input 



image based on what includes the pixel among the restoration image fields selected by 
the restoration field selection means. 

[0124] Therefore, two or more image fields are taken to each pixel of an input image, 
and the lack chrominance -signal value on each image field is restored based on the hue 
Seki parameter on the image field. Since only the restoration result judged to be reliable 
is selected and it is used for restoration of the lack chrominance -signal value of each 
pixel, the artifact produced by using an unreliable restoration result can be controlled. 
Moreover, since restoration of the lack chrominance -signal value of each pixel is 
performed based on two or more restoration results in relation to the pixel, restoration 
strong against a noise is attained. Furthermore, since the restoration result of each 
image field is used for the judgment of the dependability of direct restoration, 
processing with more certainly efficient evaluation of dependability is attained. 
[0125] (3) A characteristic quantity calculation means by which the above-mentioned 
field extract means calculates the predetermined characteristic quantity relevant to a 
hue Seki parameter based on the chrominance-signal value which exists near the pixel 
in each pixel of the above-mentioned digital image, An image processing system the 
above (l) characterized by having a division means to divide into two or more image 
fields near each pixel of the above-mentioned digital image based on the characteristic 
quantity computed by the above-mentioned characteristic quantity calculation means, 
and extracting each divided image field, or given in (2). 

[0126] This configuration corresponds to the gestalt of the 1st operation and the gestalt 
of the 2nd operation which is shown in a list at drawing 9 and drawing 10 and which is 
shown mainly in drawing 6 thru/or drawing 8 although it corresponds also to the gestalt 
of the 3rd operation shown in drawing 1 thru/or drawing 5 . That is, in the gestalt of the 
2nd operation, a field extract means corresponds to the reference image count section 58, 
the reference image buffer 60, the block extract section 62, and the block division 
section 64, an after characteristic quantity calculation means corresponds to the 
reference image count section 58 so, and a division means corresponds to the block 
division section 64. In the 1st gestalt, each of field extract means, characteristic 
quantity calculation means, and division means corresponds to the field extract section 
20. In the 3rd gestalt, each of field extract means, characteristic quantity calculation 
means, and division means corresponds to the block extract section 62. 
[0127] According to the above configurations, in a field extract means, a characteristic 
quantity calculation means calculates the characteristic quantity relevant to the hue 
Seki parameter which expresses hue Seki in the pixel with each pixel of an input image. 
And a division means carries out field division of near which is each pixel based on 



characteristic quantity, and each subregion after division is extracted as an image field 
relevant to the pixel. 

[0128] Therefore, on the occasion of the extract of an image field, the deep characteristic 
quantity of relation is computed in the hue Seki parameter near [ each ] the pixel from 
an input image, since the image field extracted based on the characteristic quantity is 
determined, the hue Seki parameter on each extracted image field becomes what has 
high dependability beforehand, and generating of an artifact can be suppressed more 
certainly. 

[0129] That is, the restoration approach of the lack chrominance -signal value which can 
generate a high- definition image that it is hard to produce an artifact by all the parts of 
an image can offer by taking out positively only the high field of possibility that the 
assumption prepared about hue Seki with the above-mentioned configuration using the 
description calculable from input images, such as brightness, will be materialized, and 
restoring a lack chrominance -signal value using the information on the field. 
[0130] (4) The above-mentioned hue Seki parameter-estimation means is an image 
processing system given in the above (l) thru/or any of (3) they are. [ which is 
characterized by to presume a hue Seki parameter only when it has a dependability 
prediction means predict the dependability of the hue Seki parameter based on the 
chrominance-signal value which exists on the image field corresponding to the hue Seki 
parameter, in advance of presumption of a hue Seki parameter and it is judged that the 
dependability is high ] 

[0131] This configuration corresponds to the gestalt of the 2nd operation and the gestalt 
of the 1st operation which is shown in a list at drawing 9 and drawing 10 and which is 
shown mainly in drawing 1 thru/or drawing 5 although it corresponds also to the gestalt 
of the 3rd operation shown in drawing 6 thru/or drawing 8 . Namely, as for a 
dependability prediction means, average / distribution evaluation section 24 
corresponds. 

[0132] According to the above configurations, in the parameter estimation in a hue Seki 
parameter estimation means, when a dependability prediction means predicts the 
dependability of a hue Seki parameter from the chrominance-signal value on the target 
image field and is predicted to be unreliable, it is made not to compute a hue Seki 
parameter. It presumes, when it is predicted that it is high. 

[0133] Therefore, since calculation of a clearly unreliable hue Seki parameter can be 
prevented, generating of an artifact is suppressed more certainly and processing speed's 
improves. 

[0134] (5) The above-mentioned characteristic quantity calculation means is an image 



processing system given in the above (3) characterized by calculating the average 
brightness value or average hue in near of each pixel of the above-mentioned digital 
image, and considering as characteristic quantity. 

[0135] The gestalt of the 2nd operation this configuration isindicated to be to drawing 6 
thru/or drawing 8 corresponds. That is, a characteristic quantity calculation means 
corresponds to the reference image count section 58. 

[0136] According to the above configurations, a characteristic quantity calculation 
means calculates the average brightness value or average hue in near of each pixel as 
characteristic quantity relevant to the hue Seki parameter which expresses hue Seki in 
the pixel with each pixel of an input image. 

[0137] Therefore, the dependability of the hue Seki parameter to each field divided by 
the division means improves by being able to calculate stably near each pixel and using 
the brightness value whose effect of moire is a small amount. Moreover, the 
dependability of the hue Seki parameter to each field to which a brightness value is 
similarly divided by the division means by changing to a brightness value in the edge 
section from which only the color is equally different, and making a hue into 
characteristic quantity improves. 

[0138] That is, the restoration approach of the lack chrominance -signal value which can 
generate a high-definition image that it is hard to produce an artifact by all the parts of 
an image can offer by taking out positively only the high field of possibility that the 
assumption prepared about hue Seki with the above-mentioned configuration using the 
description calculable from input images, such as brightness, will be materialized, and 
restoring a lack chrominance -signal value using the information on the field. 
[0139] The above-mentioned digital image is obtained by the 2 plate image pick-up 
system. (6) The above-mentioned parameter selection means The hue Seki parameter 
presumed by the above-mentioned hue Seki parameter estimation means is used. The 
presumed error of the estimate at the time of presuming another side from one side of 
two sorts of chrominance -signal values which already exist by each pixel on the image 
field corresponding to the hue Seki parameter, and an actual chrominance- signal value 
is computed. An image processing system given in the above (l) characterized by 
evaluating the dependability of the hue Seki parameter based on a presumed error. 
[0140] The gestalt of the 3rd operation this configuration is indicated to be to drawing 9 
and 10 corresponds. 

[0141] When the image obtained by the 2 plate image pick-up system is inputted 
according to the above configurations, two kinds of chrominance -signal values are 
acquired by each pixel of an input image. A parameter selection means calculates the 



estimate of the chrominance -signal value which exists in each pixel of the image field 
which corresponds using the hue Seki parameter first in evaluation of the dependability 
of a hue Seki parameter. The chrominance -signal value of another side is presumed 
from one chrominance -signal value among two kinds of chrominance -signal values 
which exist in each pixel in that case. And the error of the estimate of each pixel and the 
chrominance -signal value of the same kind which already existed in the pixel is 
calculated. 

[0142] And the dependability of that hue Seki parameter is evaluated based on this 
error, and it is judged that it is unreliable, so that an error is large. 

[0143] That is, unlike the image obtained by the veneer image pick-up system, two 
kinds of chrominance -signal values exist in the image obtained by the 2 plate image 
pick-up system by each pixel. Therefore, a parameter selection means can dare presume 
the chrominance -signal value which already exists using a hue Seki parameter by each 
pixel, and can investigate the error of a presumed result. Consequently, reliability 
evaluation of a hue Seki parameter can be performed certainly. 

[0144] (7) The above-mentioned parameter selection means is an image processing 
system given in the above (l) characterized by evaluating the dependability of the hue 
Seki parameter based on whether the value of the above-mentioned hue Seki parameter 
is included in the predetermined range. 

[0145] Two, the gestalt of the 1st operation and the gestalt of the 3rd operation shown in 
a list at drawing 9 and drawing 10 this configuration is indicated to be to drawing 1 
thru/or drawing 5 , correspond. That is, a parameter selection means corresponds to the 
parameter evaluation sections 32 and 32b. 

[0146] According to the above configurations, a parameter selection means estimates 
evaluation of the dependability of a hue Seki parameter from the value of a parameter 
itself. The range of the value of a parameter investigates the inclination of the value of a 
hue Seki parameter in case the dependability of a hue Seki parameter becomes low 
beforehand, and is set as the range in which a hue Seki parameter is experientially 
judged to be reliable enough. If a parameter selection means investigates whether the 
value of a hue Seki parameter is contained in this range and is not contained in it, it 
judges that it is unreliable and that it is reliable if it enters. 

[0147] Therefore, since other data are not needed for evaluation of the dependability of a 
hue Seki parameter, it can carry out at high speed [ reliability evaluation ] and simple. 
[0148] (8) The above-mentioned restoration field selection means is an image processing 
system given in the above (2) characterized by detecting a pixel with a 
chrominance-signal value which is greatly different from the chrominance -signal value 



of all nearby pixels from the above-mentioned restoration image field, and judging the 
dependability of the restoration image field based on a detection result. 
[0149] The gestalt of the 2nd operation this configuration is indicated to be to drawing 6 
thru/or drawing 8 corresponds. That is, a restoration field selection means corresponds 
to the artifact evaluation section 70. 

[0150] Here, in the restoration image field restored by the field restoration means, when 
the dependability of a restoration result is scarce, a specific artifact appears. This 
artifact has the description of taking the value in which that chrominance -signal value 
was widely different from any chrominance -signal value of a surrounding pixel, in a 
specific pixel. A restoration field selection means detects such a pixel from a restoration 
image field, and judges the dependability of a hue Seki parameter according to a 
detection result. 

[0151] Therefore, the dependability of a restoration result can be certainly evaluated by 
detecting the description of an artifact clearly from a restoration image. 
[0152] (9) The above-mentioned hue Seki parameter estimation means is an image 
processing system given in the above (l) thru/or any of (8) they are. [ which is 
characterized by for above-mentioned hue Seki assuming that formula T=alphaxS+beta 
is satisfied to two sorts of chrominance -signal values S and T, and setting Parameters 
alpha and beta as the hue Seki parameter about S and T ] 

[0153] Three of the gestalten of the 2nd operation and the gestalten of the 3rd operation 
shown in a list at drawing 9 and drawing 10 this configuration is indicated to be to 
drawing 1 thru/or drawing 5 and which are shown in the gestalt, drawing 6 , or drawing 
8 of the 1st operation correspond. 

[0154] According to the above configurations, a hue Seki parameter estimation means 
assumes that hue Seki to two sorts of chrominance-signal values S and T of arbitration 
satisfies formula T=alphaxS+beta, and Parameters alpha and beta are presumed as a 
hue Seki parameter about S and T. 

[0155] Therefore, when the image field extracted by the field extract means is 
sufficiently local, hue Seki in case [ complicated ] the body in which the image inputted 
has two or more light sources and a specular reflection property is included can also be 
expressed by using the linear expression which has two parameters as a formula 
expressing hue Seki. Consequently, the range of the field which the dependability of a 
hue Seki parameter falls and an artifact generates can be made small. 
[0156] Namely, by carrying out the parameter expression of that which is flexible as hue 
Seki of the partial field of an image with the above-mentioned configuration, and taking 
the count approach which restores a lack chrominance-signal value using the statistical 



property of the partial field of an image Even if it is a complicated thing containing the 
body in which the image inputted has two or more light sources and various surface 
reflection properties, the restoration approach of a supple lack chrominance-signal 
value that an artifact can respond also to various image pick-up methods or mosaic color 
filter arrangement few can be offered. 

[0157] (10) The above-mentioned hue Seki parameter estimation means is an image 
processing system given in the above (9) characterized by presuming the 
above-mentioned hue Seki parameter based on the statistic especially the average, 
distribution or the maximum, and the minimum value of the chrominance -signal value 
which exists on the image field corresponding to the hue Seki parameter. 
[0158] Three of the gestalten of the 2nd operation and the gestalten of the 3rd operation 
shown in a list at drawing 9 and drawing 10 this configuration is indicated to be to 
drawing 1 thru/or drawing 5 and which are shown in the gestalt, drawing 6 , or drawing 
8 of the 1st operation correspond. 

[0159] According to the above configurations, a hue Seki parameter estimation means 
divides the chrominance -signal value on the image field which presumes a parameter 
according to a class, and calculates the average, the distribution or the maximum, and 
the minimum value for every various kinds. Next, the square root of distribution or the 
difference of maximum and the minimum value is calculated for every various kinds, 
and the magnitude of fluctuation of a chrominance -signal value is estimated to be it. 
And alpha of the hue Seki parameters is computed from the ratio of the magnitude of 
fluctuation, and it considers as estimate. Next, beta of the hue Seki parameters is 
computed from the mean value of computed alpha, the average or maximum, and the 
minimum value, and it considers as estimate. 

[0160] Therefore, by presuming a hue Seki parameter by the statistic about a 
chrominance-signal value especially the average, the distribution and maximum, and 
the minimum value on a corresponding image field, it becomes unnecessary to limit 
color filter arrangement of the image pick-up system used for obtaining an input image, 
and a hue Seki parameter stops being influenced of a noise easily, and the restoration of 
a lack chrominance-signal value strong against a noise of it is attained. 
[0161] 

[Effect of the Invention] The image processing system which can restore the lack 
chrominance-signal value which can generate a high-definition image that it is hard to 
produce an artifact by all the parts of an image can be offered by restoring a lack 
chrominance -signal value only using the information on the field which judged whether 
it would be materialized in a field with the assumption prepared about hue Seki 



according to this invention as explained in full detail above, and was judged that an 
assumption is materialized. 

[0162] Moreover, according to this invention, the image processing system which can 
restore a lack chrominance -signal value strong against a noise can be offered by 
processing by synthesizing hue Seki of two or more near related with the pixel of 
opposite Perilla frutescens (L.) Britton var. crispa (Thunb.) Decne. to a certain pixel. 
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[Brief Description of the Drawings] 

[Drawing ll It is drawing showing the electronic camera structure of a system to which 
the image processing system concerning the gestalt of operation of the 1st of this 
invention was applied. 

[Drawing 2] It is drawing for explaining a hue Seki property. 

[Drawing 3] It is drawing for explaining a hue Seki parameter and its computing 
method. 

[Drawing 41 It is drawing for explaining the dependability of a hue Seki parameter. 
[Drawing 51 It is drawing for explaining the effectiveness of hue Seki parameter 
selection. 

[Drawing 61 It is drawing showing the electronic camera structure of a system to which 
the image processing system concerning the gestalt of operation of the 2nd of this 
invention was applied. 

[Drawing 71 It is drawing for explaining the processing in a color edge field. 
[Drawing 81 It is drawing for explaining the processing in a material homogeneity field. 
[Drawing 91 It is drawing showing the electronic camera structure of a system to which 
the image processing system concerning the gestalt of operation of the 3rd of this 
invention was applied. 

[Drawing 10] It is drawing for explaining the reliability evaluation of a hue Seki 
parameter. 

[Description of Notations] 

10 Electronic Camera 

12 Body of Processor 

14 Veneer Primary Color CCD 



141 GCCD 

142 R/B Check CCD 
16 A/D Converter 

18 Input Image Buffer 
20 Field Extract Section 
22 Field Buffer 

24, 24a, 24b Average / distribution evaluation section 

26 Filter Arrangement Maintenance ROM 

28, 28a, 28b Parameter calculation section 

30 Parameter Buffer 

32 32b Parameter evaluation section 

34 Pixel Restoration Section 

36 36a Output image buffer 

58 Reference Image Count Section 

60 Reference Image Buffer 

62 Block Extract Section 

64 Block Division Section 

66 Block Buffer 

68 68b Block restoration section 
70 Artifact Evaluation Section 
72 Linear Interpolation Section 
74 Addition Average Section 
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4fcs^-rs 0 051^9^ a@s* 

n, 4 6«D/^y-^-b'y h 5 2*^ffiS 

nrisma7tgi5 3 4(cf£^$ns 0 

[0 0 4 6] @M7tgfl3 4(4, 1^77722^5 

SfefB^ttT, (TttR, G, B<0-5^S7?ft^fe<D) 
«, iAOS (6) {C£t>Jf£-f3o 
[0 0 4 7] T P =a s , X S,. + 

••■ (6) cn«, 05lC*5V>Tj$g 

>y htciOffSnfcTp <DTOffl^ItSLTftiH^<D 

5c ^7^-?t7 H*^<MSnTC:*l/^{4 > si 
^«7tg|53 4 (i, »Vy77 2 2^6agIf^ 

fefi^T©TOfi^asB^©^Sfeft^ffli:-r5c m 

&BMM<D 3 fefi^fi^UJylB^A-y 7 r 3 6 © 

7-rsc 

[00 4 8] cctixvyimtf&mmicttLx'fttotiz 

tti^H^/Vy^r 3 6tc(4, fefS^co^^m 
flfc/iiR G BBff^iSn-Sc 

[0049] **fis<D^-rti, ffi&mtum ow&m 



(7) 



11 



¥9 2 4Rtf/<7*-*fffiBW3 2K<J:o 

t*«±» *ws-j»«4 e icfti^T «•*»©&«■/< 

[0 0 5 0] feffiB§*/<7*-**2 0£A,7£j!e 

(2) T-SLT^5fc46, ZBzmwikfttvswmmft 
[0051] f&ffliH/^-^KDfltsjcfc^Tfcx am 

fcfe, ffl*0ft7^1/*EE**r*3#fi«H»&Jctt£ 

[0052] f/c, c<Dmm<DBmicim*%%B, % 

MAX_t - M INt 
a " "MAX s-MIN a 
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^su:**-?**. n©^, mmmm^2oit, &b 

[0 0 5 3] JfMSflfeC C D 1 4«Dfe7i'/l/^BaS{iffi 

*i£> /<5*-*a« , /S„ M\ 3 (5) KfftooTK 
££ttfc£feff^©Jl*ffiMAX_cRtf§/h{lM I N 
_c (cfir, g. b©fpjtl^) T^lXT^ica-^^ 

[0 0 5 4] 
[ft4] 



At- 



MAX t + MIN t 



-<z„x- 



MAX s + MIN a 



(7) 



[0 0 5 5] Sfc, fefflH^gfM^s*: (2) fCSUO^ 30 
££9 So tWJtfcf, ^ (2) T*/3, t =0 



2ft-f3S*<!:&£>iS (3) *«fcO#L<ieaT-t5li 
3R«7E«3 4k:*j»t5«»W&^«feffl^fii»lift»cfe 

J>*4^7c^h;l/i:**LTi'7X^'J>^U «fc 

[0 0 5 6] ¥£D-#&bWIS2 4tcfe»tSfefflD8/<"7 
^-^cOffl^tt^Iilffife, S (1) W»£l«OtO*' 



Stffett, iSiIti:St»Tff5^T*«S (1) iO^St 
[0 0 5 7] fig«tttti<0tt#fC-D^Tfc» &Bit©$aJi 

[00 5 8] IB 2 CDMffi<DBm m 6 fi, 

2©n«©«!i8fc*^^ii«jasaii<oafflsnfc«? 

[0 0 5 9] LOt^A^^v-AfiU;, tf*^7l 
f*i 2i:^e>Sfig?nTV>S 0 *JI)5SO^{ci3^T 

it. *»i 2^(cii, xiim^yyr i 8, pmmwi 

Sf-J(ffl55 8 , #88iSfiKy7r 6 0, 7p -y ^ttttig|56 
2. 7P-v^^|lJg|56 4, 707^777 6 6, W 



(8) ftfflW- 1 1-215512 

13 14 
•#ftffffi»2 4a, 7f/l/^BEBf£#R0M2 6, ^ * [0 06 2] £*5, HJfcHfiVW:77 3 6 a©tMjtt % 

7*-*gtti^2 8 a, 7o>y?«^g[56 8, 7—r-f S£&3!&lt*tt 1 2 O^gP^ffi^tl, HuifiOS 1 © 

77*hffffl»7(K ffi$fflfflflS7 2, «g¥^7 UttOJBJgfcRlttJC, lISffiagB*** 1 2 CD$«:, 

4. U*ii/W77 3 6 a*«E«nT^«. Wittf, J P E G *©H^<B%£*fHE*8*a®fl5i: 

[006 0] <1CT% A*»H<i!/W7 7 1 8©a*tt» ><*!J*-K^G1tKtt£&EU ±Km7Ji»W 
#BSBH£H-gSB5 8, 7n-y^tetUSl56 2, SCf« 77 3 6 a *»SHl^«n**7— r-f S?*7Mi»£ffiB 

BBH«/W:7 7 6 0fcA2j;£tt. IS#F.iH{0/ < ; , y77 6 fc, 06 CfiaST^f «k 3tc, M^Jo*? 1 0 

0cOtU7J{i7n<y^^SiJgl56 4lctitfj£ftS. 7 B$<* 1 2, &tfBa*L4^ffffl«lSffii:ffl««f**- 

a-y^ttti}g|56 2cotB^tCC07n-y^^tiJg|5 6 4KA 10 o©gf*K-M:LT, ^Sfii: LT4S$LT 

7 6 6KA7j£ft, Rrn7^7 7r6 60JUAlif [0 0 6 3] H6fC^tfe«t3ft*!j3ctC*ttS» 

$ • #pftf¥ffiSP2 4 a&tf7D-y^^7tg|56 8lcA7j£ {t^l^lT 3 0 

n§ 0 • -ftmm&2 4 aiaz7 j jif&muftR [0064] n?fit? i oic&vmmmhtizt, 

0M2 6<Dtt»#t,A2j£*U R¥JS-#ttfftt«52 4 a IjMSlifeC C D 1 4 5<DfI*§{4s A/D3^-?l 

0titfj(4/<7*-*llttJ»2 8 atCA77£n§ 0 /^^< 6 5;gtf-f 1 20AAI«/<y77 

-£BTO2 8 a£Oab7U(i7n-y^^g|56 8tcA7j£ 1 8 Cf^ i?*JlSH&mto£ LT1KM2: n«„ l^t>>- 
ft, C<D7n-y?«rc»6 8£t4MK:7^*EH«# D»«Lfc«£fc1#6nSlSlRG B 

R0M2 6<9to/7#A73;*ft3 0 HflW^HXtcR. G. BtQHfflgiO!)fe{IW£W-f -5 
[00 6 1] IS7n-y^&7Cg|56 80tB#tt7— f*7 20 OfcfcfU CtD-r-C^^^fiiffltSttftiBJlSC^SSfe 

7^7 hg¥ffl357 OlcATJ^n, 7-xf77^ hsfffigp C C D 1 4 ©fe7^;U*EBfc/SL;T-ffl!IIt9&ffi*fffi 

7ooffl*tt«iii¥^aJ7 4ftA**nso ccoag¥ Ltmitr. m<D2mm<o&m^mitk%LT^z 0 * 

7 4 KliglCflDBffinffi 7 2 &tf ffl^Hflfc/ W 7 7 C ?\ #ft 1 2 ft 7 fix* ^^^^S^CO^H^T^ 

ft6«HgffiHSP7 2&tfatfjHflVW7r 3 6 atcAij 9»«^fc*£fcf§SftSlgRG BHf**«rc**^ 

$n^„ ttS73H^/^<y77 3 6 a ti, A/7lHf!/^y77 *'n? 0 CtDmfiWMit. A7jMm^v77 1 8rt«D-r 

v7T<D&mm&Wfcm%)hfrmjt>ftrcmmi£{%mt [o o 6 5] n?**^ 1 o*^*» 1 2^cob^co|k 

5/£a6K^tStiTt^o *HSS©^T*{4 > JUUIttU;: 30 a£tfl*7-f£&. £-f*J!&M«fH*SB5 8 #A7JiH«/< 

A*jB«/*v 7 7 l 8 ©^H*ffiBK:»«Lfcaa©fe 77/1 8 rtcDxV 57^;U*fill«KWTtc^-rS 
te^«£fi*&WLT*ft6*ffl#ii«/<-y7r3 6 (8) <0M^O3x3iI«P-/U7^;l/^^ 

a fc«*LTV£, «gffift<ft%(Cj&*¥J3g|:7 4 T*¥ It, ISS^#Hi/^7 77 6 0 (CMHBftfc LT#t 

fToTi/^o c^aKat&ftHsat&gtcfcSo * [0066] 

0.0625 0.125 0.0625 

0.125 0.25 0.125 - (8) 

0.0625 0.125 0.0625 

C©±9K#«H»a»Sfi»n— /<X7V;l/*E«fcoT [0 0 6 8] 7a-y ^fi6tBS56 2 tCioT, A*jBflV< 
ItS^ttfcHftte, J£tgH<£tC#JfcT3JICRG BH<£<Q 40 y77 1 8^(074 is 5)1 &1&Wm<D&±mfrC>g-f ft 
W&mftO. 2 5R + 0. 5G + 0. 2 5B©ffi«l£# O^T'TTJlSj'Ni: 1 BX^OjeigftWOttBA^j* 

%S«fSt.O»c4oT^5o 6$n, «»fiH«rt<DiB«^)®*K*ttlSnSo 7a-y 

[0 0 6 7] a^jiS«/^y77 3 6 art©#ii* ^tttija56 2 tc J: OttftiUSft, ^acOteSofcBft * 

cOH^ffSt>"*7>^^ roj icWMitZtis AJimm &B7u<y?m£o WTcQflia{4£a7n>y 7tffex 

^•y77 1 Srt^fV^/MUglifcKl^ttSt-^T -y-78i«4 4 fCJST «AiR^-flW4 6(c«-rSA^ 

CD5 x 5®*1MX©iejBiB«fc:#LT\ ^cOSQilWT AoT^LSSotfet), i7^fei7->M4 4fitt 

sfefi^fi (s(4r, g, Bcoftjn^) ^m^mtn t 

Kj:»)jKjssnsa«**offi«rt«sfeffl«Fi:i?j:c: [0069] wt, saaoittB^(i±fcia7{cs-^^Ttf 

itt4. 50 iiB7D777 6(4, S-f7a-y^^-|ijg|56 4 {C|e 
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ttftpmrnm s^m^mu ttftpmmm spwm 

*f[R e f MA X&tfg'MlR e f MI N£fmTS„ 
fit, a5^#SiS®7 8fr5> (RefMAX + Ref 

mi N) /2*Kfii: LTli^fl r i j srcte roj £ 
n-0~mitmm8 0££/£TS o #t;:ii@7P-y7 7 6 

oflsstwis-r § 70 -v ^ a 82, stf -ffi fta«± 
rmmm roj %ifoja«KWfl;-r*7*o.y^B 8 4 

%4jS-T*. *LT, 7P-y*A 8 2M7n 7 ^B 
8 4 £7p -y ^7/S-y 7 7 6 6 
[0 0 7 0] H5a©«t5t, #JHE«M>-a5T?fc<a»# 

#Hi7 8(i/^R c BjBttowfiis^cffl^-rs. * 

©fca* ffiM^jSBtt 7 8 oz:«ftB# 8 0 (c till R G 
BH«<Dxyj;«j6tfEI»;*n. 7n>y^7A 8 2, 7 
□ v t B 8 4tfX7 ^©£eoffi«»C Jtffir So If? 1 

•yvW4 4T'li, xy^Ofc&ttJRWJSHW^ 6 
X\ URG BHficDfeff^3 8fc#$ftSK*R»#K:W 
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Ttft^*&1»t., 7n-y^A 8 2, 7a-y^B 8 

[0 0 7 1] '7 r ny^/^y7r6 6JC2 00Hfil* t »# 

f#R0M2 6»cEtt«nrt^a7-c;l/^OEB1WB* 
K#lHU 7P-y^A 8 2, 7a-y^B 8 4&*fC 
ti^Tfefl^R, G, BA^nfnie.ftSfil^ 
10 "TSo ^LT, 7n-y^A 8 2, B 8 4 

T*OlW*?.S&ft*feffl#C0fflRN« (A) , N< 
(B) , TOfAc (A) , Ac (B) , SD'^tilVc 
(A) , Vc (B) (CtiR, G, BOfln* 1 . ctt 

r, g, b©Mnft^fem^coaa*af»^T?« 

S) fcltS'tSo cn5<Dffi^67P«y^A 
82, 7P-y7B 8 4 (Merge ) btc&SZTa 

7 B^tttCO^TeWffiA. (M) &tf#»Vc 
(M) (9) tCiOIt^-TSo 

[0 0 7 2] 
20 [»5] 



y „ N c (A)xVc(AHN c (B)xV c (B)+N c (A)xN c (B)x(A c (A)-Ac(B)) 2 
C N C (A)+N C (B) 



A C (M) 



N c (A)xA e (A)+N c (B)xA c (B) 
N C (A) + N C (B) 



(9) 



[0 0 7 3] t CftSWSfflfttfftlR*/^* 

£>i§£, *<Ditf 7p -y^A 82tB 84 30 
n7c&g7P-y^£ftfc|?rf SlT'&SCt^U £ 

[0 0 7 4] /<7*-*J«iJfflS2 8 aT-ti, (E2ISnfc3K 
T = a» (X) XS + /S,, (X) 
?LT> S (5) fcR«fcfetBIW/<5*-**:*<E>5£ 

(1 1) KJ:*>frirr*o fcfccoa (1 0) . (1 
1) {C*5l>T, S. TfiR. G. B<DHn^T'5VHcS 
45o s, t li^Wfft S . TiC^jSLfc^T* 



«¥^fiR0 r ^^b?±B7P-y^7 6 ,7P-y^7A 8 
So &7P-y7A 8 2.B 8 4 RtfaB7n <y ^ 7 

6±mc*3^T, mKonmiDBmictsvzjK. (2) t 

ra«K* fefl^S tTOH«<Oi? (10) ^M^f 

So 

[0 0 7 5] 

★ XfiA, B, 
[0 0 7 6] 
[&6] 



- (10) 
MCDWlfrT'fcSc 



Vt(X) 
(X)' 



ft t (X)= A,(X)-a st (X)x A S (X) 



(11) 



[00 7 7] =tLX. /<7*-*WfflSS2 8 afi7P-y 
^A 8 2Rtf7n«y£B 8 4 ©fetBBH/^;*-** 

s, (M) , Us, (M) £7P'y^*I^ai5 6 8(C$£g-t 
So *5T?fci^if^ 7P-y^tc^tSfefS^fiS<0 

man, (x) +n„ (x) +Nb (x) tt&^-noy? 

P77X (XfiA, BOfRin^) KBSf SfefBM^-7* 50 



-*a„ (X), 0„ (X) ^r7P-y^«^g|36 8tCfK 
[0 0 7 8] C1CT\ H7atfH8%*jai/Ts 

-*smgi32 8 a^&igji^nsfefflM/^^-^tco 
co j: a tcfex-y 4 4 tcjs-r wk^t 

SSffl5##J&g«7 8 (cS-^V>T7p -y ^»I"J^T9 C 



(10) 
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fcoTJHHWIiETfcSo 335tc. gfl»#!»SB{§8 8T*7o 
•y^*^»J*n«i:, 7n7^A 90, 7n-^B 
9 2TttH*»W>4v*fc», fi*IM/<7 

a tt, #M££>7n -y 7 ©fi«H/<7 *-**Jt« U 
[0 0 7 9] 7n-y*&7cg|56 8T-l±, (EiMSftfc&ffl 

o 0 eas«nfcfe*ai«^7y-^^a- (m) , 0 

si (M) <DJf£\ 7n-y^/^77 6 6^C>2O(07n 
©T'D'y^tKI-rSt^Tfentf, 7D7^777 6 

6^€>isa-r§7*n-y^^M*tb-ro ^lt, i^tHL 
<Dmms csttR. g, B«Mn*») ^tv^ES^ 

SROM2 6Cl&W?nTV^fe7^;l/*EB1il«*^ 20 

is) zmi<D%m<DBmtmmfc5£. (6) jb^*«6s 0 

Sp <A P s -k x op s XtiS 
S(12) A«JE«nfcii*{i7—r-f7r^h«4ii 

Hffl*T®oTV*#&«:» «7c7n-y7{C7-7f 7 30 
¥^»7 4fc<ESIf 5o f^T^l^ '*^7D>y? 

COO 8 3] 4{±, 7— r-f777hffffi 

g|3 7 0A^«7c7n-y^^lE3Mv*nfc^{C£D^ WT 

[0 0 8 4] S1\ 7n-y7ffi7cg|56 8A^«7t7n«y 
tZm&tiiT, ZLX. ffl7t7D-y^<D#H^P{C*5^ 
T, m^3ii»/<«y77 3 6art<0ii3RPfC>ttS-i"«ffiH 40 
««»[ffi{c'(t^7n -y * 9 6 <DBIi P fefl^ffl 
£J£LJAt? 0 fit, ttfiH»/W77 3 6 artCiijR 

[0 0 8 5] A7^aa/Vy7 7 l 8rt07*<rS?*;M|MK 

[0086] roj <z>ss x iiin 

SP7 2KH*P<DffiH*»l6-&S. SSJ&MS&7 2t4B 50 
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fcfefBM/^^-7;^, (M) , ft* (M) cD^-g-ti 

aa7o-y 7 8 6^ttofeffl#o^«*««7csnfea7c 

707^9 4 A\ ^(Dmn^iizrn y 7 A 8 2,7 
D7^B 8 4"<DHn^(C^-r-5«7c7a<y7 9 6tf£ 
^nsci:lc«;5o «7c7a-y*i47— r-c 777 h 
l¥ffig|57 OlCfg&^n, «7C*6HfC7— r-f77 7h*t 

[0 0 8 0] fex>y-7^4 4KfcV>TB£-f 37— f 

*5ffi**-rfcl^3t.<D-l?fc3o 7-7^-77^ 

gfii 7 0 fri. ^7c7o-y7lC#$n3C<7)7-7^77 7 

[0 0 8 1 ] ^tmi&fefB^fS (StiR. G, B©Hn 

feft^ffiSp *Jt«U feff^fflSp tfi£8rt©B*X 

*oT^«l|^fi, 3x3iBiRifi«rt©feffl^O¥^ffi 
A P s S^iiio, s (sttSCMn^) £ 
ftWU ®*P®«tfffi3£0£ftkKttLT#©5£ (1 
2) *»£*Sfr£5jWW'<;5. 
[0 0 8 2] 

P > A P s + k x op s •••(12) 
*P*(p4>fc-rS3x3B*ffi«*ArtH»/W7 7 1 

t, *(D3eLtmm*fcW¥i%%n 4iag&f5, mm 

WSP7 4 14, K2!2nfc«7cffl*ffl7Jiii«/W ^73 
6atc#tiA& 0 £777# l"oj T&^ii^ «W¥ 
fc^SP 7 4 (±SIJ*ffl&:*7 7 > £ T'f J o T»P lCf# 5 tlfc 

m$HD'&7im<D¥i%mzm. com^mmm^-y 7 7 

3 6a icWZ&tSo ZC%X'<D®M£im7tZ£, Hit] 

mm^y 77 3 6 a {cftfi<f<D^s^at>tife® r c b 

[0 0 8 7] *HfiS<D}gSlT'(i, A73Bf!/W7 7 1 8 
ffxDTW i?*)\,Wmm fr<i7u y 7ttltB»6 2 ^ffijg 
ffiWZ-?t> L, 7n >y 2#fjffl5 6 4 

®«if-»» 5 8 1 «k •? #«b«*^ 5>i+s$ nrc^mmm 
icm^ryu vt*mtt®-m® 4 6 fcsnwr §«g 

*, «'|i|Lfc7P-y7{CO^T>'^^-7gmgP2 8 a 

T, 7o-y7^7cg|56 8tffetBM/<5*-*£S-3^T 
7a -y ^co^SfefI^±T«7C LT'«tc7p -y ^7^4 
fiKU ®S¥^gl57 4*^7-7^777 Mfffigp 7 0<3D 
i¥<BfcSo*^T7-7f 77^ h£>#$n&i/Ml7c7n 
7^©%Hi7Jii^777 3 6 atCfflgELTtK 



(11) 
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T\ tiij]M®'*y 7 7 3 6 a ©§H^fcfel>T^<DH^ 

timm^yyr 3 6 a\z&t>zn%ztT\ firsts 

MtcS^fcftlgfeit^Cfc^TfeX >y >?g|5<Difi2T' 
£C£7-f--f77*h£f&C <fc9iift<£> 

is^jn r g b mmttat>mm'i'y y r 3 6 a w§3 £ 

fc* «rc7D-y?©7-T^77? h£it&I¥{ffi-f 3c 
£TJ:96tfl&7~ f^77^ M5££WT*.3i:^9 5& 

[0088] c(onmmmicimm<Dm\ <dm 

CD 1 4<9fe7^;U*ie?U J £vW-**ti}g|52 8 aK 20 

■ ^\mm^2 4 aK&^rfeW'^-^sai-f 
[oo8 9] #p.BMiitsa5 5 stcckoitssns^ 

hi¥ffia$7 o(c*5^§7— 77^ hriffi^ts mm 

^<DT&tH£imr$>^ a m x.lf x >y i/'^t±i7 s 

[0090] 7v-y<!7ftmmastf%mi&ft$\i£&, - 

ffifk fclfi 6 -f » o 7 u > jgffl t? * 5 c i: u 
[0 0 91] [i? 3 <Dmffi<D&Wi 09 «, 

[0 0 9 2] £<Dm?l)X^i/X7-l±t,±. |f*^7l 

ftl 2i*»6»jS$nT^«. *Hfig^ff^{Cj3^T 
WU l?A^7l 0 tt-«3»«£*Jr&, ^<DrtS5T* 
t±, £iii*K:C7Vyl>**ELfcGCCD 14, M 50 
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R7^/^tB7-c *H*«fC ffiffitffcE Lfc R / 
BTtfffiCCD 1 4> OIHMA/Dny/^i' 1 6% 

Btfi/W7 7 1 8{CA££ft5«fc9£$$£ttT^<5o 
-77, SQa»g"*i*l 2rttll, 7D-y*fE&tfJg|56 2, 
7ny^777 6 6, ¥i^-»»ffffia52 4 b» /<5 
*-£gajg|52 8 b, ^*-*fFflEg|53 2 b, 7a-y 
7«7t956 8 b, «JFFi9»7 4, ^EM$7 2, tti 
^]IS^777 3 6 a#K£*UV5o 
[0 0 9 3] tot, A7jH{§>'W77 1 8<Dfcb7J«, 
^P-y^»aW6 2i:««ttlHI»7 2»cA7J«n*o 7 
D-y^ffcajgi56 2Wttj7J(i7P-y^/W77 6 6KA7J 
£ft, K7.n-y^/^y77 6 6«0m73«¥^'^^fi5 
952 4 b, /<7*-*ffffia5 3 2 b, Rtf7"ny *«tc 
956 8 b(ilA77$n-S 0 ¥^ • »Sfcl?fffig|52 4 bcDtUTj 
l±/-?7^-^lCtbg|52 8 b(CA7J$n, W7*-9U 
tBg)52 8 b©tti7J{i/<7*-*iffflfia&3 2 blcA^Stl 
3 0 /l7*-*ffttSB3 2 b<0tH73tt7*n-y^a7CaP6 
8b(cA73$n, ^7n-y7^7t956 8 bOtHMiffiW 
¥1^957 4fcA73?ft3 0 

[0 0 9 4] C ®»BWSB'7 4 (cttSlclflugttlllias 7 
2atfm73Dii«/W77 3 6aOta73*<A735n, 

W¥Kigi5 7 4 ©tHTjticne «os4imiV7 zjktftatim 

1^7 77 3 6 a{CA7D$n?»o UjTjH^A-y 77 3 6 
at±, A73Hff^-y7 7 1 8 rtQMk&RlttBftftOH 

^7773 6a£iILn^, «Wffi^«^fC«W¥ 
1^95 7 4 T¥^t^ tl5 C i: T*«»»ftfefi^«l^ffi^ 

[0 0 9 5] «:J3 % a7JiSff^-y77 3 6 acDtlijjti, 

a^«aasi*<* i zoft^mmzn. mm<om 1 © 

0>JAJf, J P E G$<E>H«EttJaS£fT9ffiffi8yi»i: 
77 3 6 aA>?.dJ77$n^*7-xf ->'^;l/iS{i^EIS 

H*f*i 2, &tfH^L*t^S*j(aaa5i:E«S8ft*- 

[0 0 9 6] ^{C. H9JC*Lfc«fc5a:fl|j«{Cfel7-«» 

[0 0 9 7] M?*^^ 1 0tJ:»3tH»««tt*)nSi:, 
GCCD 1 4. StfR/Bffi&C C D 1 4 2 
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#1*1 2(DAt}Wm'^y7 7 1 8£f f -i">**;l'- 
£LTts&$tt5 0 |HIi;'>-y%=fiffl«3RCJ:»)fll« 
Lfc*&K#64iS/SRGBB«*^iiil5fc:R. G, B 

-«H»tt£HSRfcR/Bi1j*ECCD 1 4* <Dfe7Y 
5o f:t-, 2rtTt4A*iB«/Vy7r l 8 ft© 



20 



[0 0 9 8] BPS, 1 0ft*6#<*l 2"\<DB 

«©«&#«?7-rSi:» t^tti^Bft^-v7 7 3 6 a ft 
©SfflJROffljRffiRtf;!;*:/*** Toj fclWJWftSft, 
A7JH«'W7 7 1 8 n<T>T4 i/Zft-fommic-Stti 

fftfC&ttSSfell^ffi (StiR, G, BcDfaftfr) 

0 tare tic& *)&i£2tizmmzz<Dffi®fi<Dsi*m 

[0 0 9 9] 7D-v^atilg|36 2 (Cj;oT, A*JH«>< 

S7ny^i^„ R*fibSftfcai7*Dv*«, 7n 

[0 10 0] fSfc, ¥£*£HKffillitf2 4 bti, 7a*30 
e P = T P - (a,,, x G P + 0 8 t ) 

l^tt^**tt, 6ffiH/<7^-*a,r , 0 8r Rtfa* , 
0» OflMBttttK^fcWRLT, 7n-v^«7tg(56 8 b 
tefeffiM/<7*-*a, . /i. Ma* , 0* 

So 

[0 10 3] 11 0(i> feX>yi/*^HK4 4lC*5t^TRfe 
ff*l<Dt§e>ft3Bi?tp£0>nc, ^Me, ©.W&H^L 

0 1 0 4>fCZlfiffi«<0fe®^9 8 L 

1 0 0*^«l!£«nSRfefi9J6S<il 0 2t. mso 
Rfelg^ffil 0 4 £<DM£SIU fefBMfcfltJSfiffittM 

[0104] -ar, Kai«nfcfefflBB/<7y-**« * 

Tp =a«. x Gp +0„ 
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* 7^777 6 6*>>Si$g7a-y7*g?#aiU £Blg 

5o aS7D>y^co#B*{c43V^TSffi-r5feffi 
W*>«S (R,B©j^nW ^R/BrfJ&C C D 1 
4z Wft7Y>H?EllOJ!WJtt*WfflLTtHir*. * 

(r, g, bnfe«9<oaa%a-ra^-pa&s) *l 

T, WlAc &tf#|fcVc (cttr. g, btDttft 
jW */<7*-*l*m»2 8 btClEHITSo 

[oioi] /<5*-*j*a,»2 8 bT*«, $mzntc 

S-f, Gfefl»©#ftV, *BrS£©M«i:J±«U BBffi 

**Maso»ioiaiiofla8rKWLfe±Ea cs) t 

— 2a*, j3h Rtfa.i , 0, b < ±|g£C 

(5) fci^ftgfSc fit, fWLfcfi«IB/<7* 
-**/<5*-*ffflia53 2 b(c$E^-r§ 0 
[0 10 2] /<7?<-£ffffffi3 2 bT'tt, IsiH^tlfc 

&3ftfc/<7*-*# a* , Hp RZfa* , 0«b 

7D7^777 6 6 6^aB7*P-y^%K*U 
■To fit, &g7n>y7cD&ijgtPK:*5^T, R/B 
m«i C C D l 4 z (Dfe7 -c ;l/^EH03SH'Jtt*¥iJffl L 
TB*PtC#ft-r^GiX^cofeft^T (T(iR, B<Dfsi 
n*0 f-^feff^flTp tGfeM^flGp , 

r, b<DHn*>) *^fifflBB/<7^-^KJ:5effl^«t 

- (1 3) 



[0 10 5] 7n-y^^g|56 8 b (i. /^^-^ffffi 

m$3 2 bfr6&ffiM><7*-*a«a&sftfc»&tt» 7 

av<'/W7r6 6j!i 4 6aa7*ny*4R*ffiU fti 
7-n y ^OSi« p 7?X«tS6ffl9«iaT (T« 
R, BO<Bjn*0 *R/BrfJ«tCCD 1 4 2 cr)&7i' 

^ iiS7n7 ^l*)©^B^P£OGfefI^ffiGp 

[0 10 6] 

- (1 4) 



50 br . 0* Rtf a* , 0,b ^e^^n/c^{c« N a@7 
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Sp (StiR, B©9^T-P4l/^<D) £B*T* [0 10 7] 

T P =ou, x S P + 0» •• ( 1 5) 

7o-y*££/£-f So d-5LT4fi)t$nrc«7u7a-y^ < Ej^iS^lTR G BMftttftBflf*? 7 7 3 6 ate 

tt. «W¥i5»7 4K<E2UfftS 0 -73, /<7*-*ff ff3C£:tfT'#3o *2Sili©JB!grt?H\ Artia«#r« 

H\ «7c7D-y *<t>£ritt,IS8fcfTfc4^o HflKsWf -Sc £T\ » l <DmfacDBmic}sifz>ii& 

[0 1 0 8] «g¥i$g|57 4ti, 7n-y?H^g|56 8b «k D £5lCj»£Wlc7-r-f 77* h©8£*«Ut5C 

*^a7C^ny**%26«nfc«^tCO*. «7t:7a-y 10 fca<nJfig,CfcoT^S. G feff ^cD^Rff 

*C&iB*Plc*tU aj*iB»^'y773 6 artOHJR fC(Si;T*HjRl?^5n*Zl«aofefi#flDif^6^ 

P tc Mfc? 3 (MO* JMSfcajcT* n <y * ©HiS P ,C ts rZ&mfilc ffl 1^3 £^ D #*. 3 C £ (C <fc (3 , G ft *f # 

tt5fefI^fa«r£Liity„ *LT* Ul7JiS®A-y77 3 /hS < G<3^0*^&Ott7cTH7^Xfl!)»»«rSlt J f» 

6 artOB*PKWf5-rs*r>7*;& r l j ig*>?o fctf?**. 
Co l 0 9] ktimm^yyy l 8 rt<0-r [o l l 3] &3b\ cnnfammiciifS l ©HS&cDjg 

H8«K:^Sn5r^T05x5iS3R-9--YX(D>gJg1S«fe: <gP)til;H£* gMtfnltET-i&So fuy^^m 

mt1V7 7 3 6 art<0#H3RP©aW«Ra : * , »^* CCD 1 4 2 <Dfe7-c;U*EylJ^/^^-*llffia52 

[oiio] £t\ roj ©t§£, isusMiHi 20 ^#£TWr*&-So 

SP7 2KH*POffiE*»l6-&«. tfUBMHffi7 2ti, [0 114] 0>JAtf. ¥^-mW«gP2 4 btCfc^T 

1 8«fc»)g!»uiL» oB*ptc#ffi-r*&©^«itt*<DS w«u mutt^fg^^a^nwKwi^T^^^ 

{ItWDflfciDMoT, H*©3feM^ffi%£ia-r 6 0 £7c> -fi»«3SOi8^{iftB7n'y*rt<DfefflH 

77 3 6 aCffjAty 0 tj7>*# T0j "?4HS^ tBB80t 2 ^ "Hi #-<Ofi«9*^TJ±i6 

«S¥i$g|5 7 4 (i^gfl^: * 7 7 * T'f J o T&Jif fcjfrg- J; i? 3 T fi «>KIS#4>ft 0 ^fctfefflH' <^ * - 

stifcaaoaTctto^ffl^iiv cofsfctuaw*/* 30 *o€j|gtta^£«K^3c set, s 

[0111] cczr*(D®mm$T?zt, mtiwm^ im&*±ifz>z tt>m%t%z a corns. ¥^-# 

7773 6 a lC&<Ef%<D%mtfffit>tircmRG BBffitf ffts¥fffig|52 4 b ^fefflKHA^Hough &&iZl£<Dffim 

[0112] Kt±©j:3c, *nsg<ofg^r-tt, atjh ««KW*s-rsia««wT©Kiis*»i:'rntf<kv\ t» 

ff/Vy77 l 8(p<D-r^i7*;l/-1gia^*>e.7n<y7tt o £fg¥£f!«&#SiJS:i: LT(i, /<9^-^fffflij»3 2 

m»6 2*'jejB®«*-f 6L-3-3tt*aL, /<5*— * bT?aa7n-y*rtto#H3Rp»cfefT!(msn5flt£ 

J?maP2 8b*'fefflRI^7^-^*!?a-r5. *t, iie, Oft*f{ctS(;Tag7D-y*£2o<Dg|5#7o 

7^-*fPfiB»3 2b^-«iii«<0#iiiS»C#a-r«z: -y *{C#iiJLT7n«y7A.y77 6 6 IC»*KU 

aa<ofeii^«^6fe^offl7cKS*jH-*-rsi:i:i? 40 ftjuyt-izvm-c/^t-zww&z 8 btit>/<7 

^-*^tt*7n-y*«7cSP6 8 btcfciMf^o f L «yHCffll/^Sfe<0*^tf €.n« 0 m2<onttH<OfB 

T, 7D-y*«7cffl56 8 b tffefflM/^-^CgoV !6i:ra*H:1*»Ji»ca^V^TiSI«»»J%JT9«^T?t, 

T7a -y *©fc£fe<I^*£T«7t LT«7G7n y LT£fflX£#fcf* G J8#*m*ftlf J: DIE 

773 6 afcflWLTV< Ci:T*> tB7jH»^-y773 [0 115] a©¥±Sg|57 4 -f>7n -y *«7cg|56 8 blC 

e>n3» *«FW»c j e-n6<0 i Pi%ffl* , ai*ll«/^«y7r3 ©«HS«fTftt>*<TfeJ:i,^ £fc. /<7^-*IMMii 

6 ata^JSnSCi:-!?, fflfiSOSlOliaSOJBSfcl^ 50 3 2 bT*&R£G£>feffllIS/^*-*, BiGODfefflM 
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[oi 16] iXlilo«Siclo*^T*%^;&iiil L 

9{C&3 0 10 
[0117] ( 1 ) TOUi&X&ZM ft$(c j; o 

J§£ L 7 - r -r ->* * ;l/Bf£ * tti tj f % W&itQM 

m*<on&Mmcttu %<Dmmffi®±<D&mm%mt 
micm-3^xmm?5eL®M'^*-*mj£^mt:. ± 20 

"T 5 feft^tfi t ±EfefflM/ ^ * - * jSft#&{£ J; t)jS 

m&zmfctzmttmt. zmmtzctzftwitt 30 
[0118] co*j«ti, 0 1 nmm5ic7nznz>mi 

/<7*-mm¥mt* w-m • wnam&z 4,24b 

JklSt^t—Zn&^Z 8, 2 8 bicttJSfSo 
-faSE#Sti, /<7*-*»fflffl53 2. 3 2 btW*S 

-f-s, w&mt, %\<Dnmmmx\mmm7i%!>3 40 

b&tf«JI¥^g|57 4 C»«-r«. 
[0 119] ±C©J:5ft«WttJ:ntf % nl^fttii#S 
*«X*H«W)*ii3l6fco#aa<oiii»ffi«*fflta U ftb 

fetiH/ ^7 ^ - ^ m&zmmg. l t/<^ * - * ft-r 
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[0120] ioT^ xt>m®L<n&mm\z.ttLim.<r>m 
[0121] (2) ^mimxit-mmmmc^K) 

ii«*^*iiiEfcof?a»offlS«:Siii«1H«*am-r 

micm^xmjz-rz&mm'V? *-*&m-®.t, & 
[0122] commt. m6nmm8ic7r,t£t\z>m2 

B«tWS5 8, #111^7 77 6 0, -fUytmm 
t56 2Rtf7n«y*#*ja56 4 tC*fiS-r*o feffiH/^ 
^-^Jfl^ati, ¥«S • #fll¥ffigfl2 4 
-^StlJgP2 8 a£*te-r*o fg««7c¥a«^a-y^ 

[0123] ±ffi<o«fc-5a*jSfc:«fcftfcf, ss^aai^is 

^A^BftcDSB^fCOta^cDBff^^tttbt, 

tii5nfcfi^cDB«ii«(c*tL, a*tH«±ofefflia% 
%o ^lx s mMstircm^oy/^yt—snc-D^mmm 
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xmn^^mm^mmu smtetf^tmmzti 
rcm7£mmm®<Dfrttmmtz>o mmmft^xHt, a 
ttwim&mmias^x. mftmmmm^mc^tymm 

co 1 2 4] u^x. kt}W&<D&mm\cnLTmi<D 

mm^tmmznrcmfcm%mwwmznT&m io 

^h^OTJf %cti?XH> a £fc, £Biit?)ft&fef§ 

[0125] (3) ±mwmmmmit, ±isx^->" 

K. «fc 0 liaiSnfcftaUlfclM^TJJEf** ->**;l/B$ 

-r*±£ (i) x» (2) ic&m<ommwmWo 
[0126] ccomi8.it. mmmmsicB-gtizmi 

8 » #PIBfi^ -y 7760, 7*a <y £ Sfctjgfl 6 2 Rtf7" 
a -y ^#fijgtf6 4 fc*H6U * 3 «F«*wai¥a^ 
#BgB&ftlEg|3 5 8lcJtJ5U #f J¥ a#7*n -y 

g(5 6 4 fcwts-rs,, % 1 <Dmmic33^?it. mmeaa^ 
a, #a»tHm Rtfaw^att^rnttwHau 

[0127] ±8so«fc54«iatc«fcntf, mmmm^m 40 

[0 l 2 8] ftoT, BBWKOJlllttlclllU A£H{£ 
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J: *) fif^CttJ*. 5 E £ T't § 0 
[0 12 9] IP^ ±fB«figT'{i, ??e&i:<DA7JB{f! 

tic < < fiOiSp D Q {4cDB^afi)c7?t5^fefi^{i© 
[0 130] (4) ±EfefflM/<7><-*«t5£¥a 

E (l) 71S (3) Ol5fti3!pfc3S*OB««iSSBo 
[0 13 1] COflWUi, 06 7!iS0 8{C^$n5^2 

USSOJBHttWtS-rS* 5 , ±£LT0 1 71SB5 £7* 

#ati, • ttKfffflSR 2 4 tfJtfST S„ 
[0 13 2] ±E0±3JMftWcJ:*itf, fefBM^5M 

/c^«fe»-?7 *-*©»il%ftfe*^ <fc 3 {Cf 

[0 13 3] B£oT, W6^»cffl«140flH,>fetBH/<7 
^-^I«(f50T'7-f-^77^ 

[0134] (5) ±i2«pa«»ai¥a{*, ±t2xi' 
(3) (cS2««tsaasSo 

[0 13 5] COi^a, H6ftMH8te^SnS£2 
[0 13 6] ±I2«J:9*fllfi!c{c c fcntf, t#a»^tii¥ 

»»J#aK:J:0«fiJSn««^OflI*KjW* 

n l < ferc^^So rv^x-y s;** if ximmmcg. 
t> otsi^ga i: -r * c t -en u < #su^a«c «t o 

[0 13 8] ±E«fi8T-{4, WS4H<0A7JB« 
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H®©£T©gl5{rC'7-7V77*l-tf£ 
Utc < < flOiS D D n{i©B{f!££j£T-t<5*8fe{§^ffi© 

[0139] ( 6 ) ±ser r -i' nmmt -w&®& 

1"*iB«SI«±<D*lltR-pBEfc:#ftT5-aofem#ffi 10 
<D-Hfre> Wfi L fc i§£©«£ffi f: HPg©fe{3# 

( i ) ic&mvmmmmmWo 

[0 l 4 0] ZOimi&li. 09&tfl 0iC^£n3fg3 

fc££iT3fe{§^{I©»£ffi£ftgT3o *©IS, &B 

[0 14 2] fLt> C4>MtflcaS-3^T?ti!)&fSH'< 
[0 14 3] oJO, & ft etifeBfefc 30 

s& o . -fomtmic «t o ftenfcBfitc fi&Bss-er 
&mw&wm ?mcft&?% &immz&*. x&mm^ 
#t*£3o *■©«*, &taiH/<7>«-^©fiattfffiii* 

[0 14 4] (7) ±E><7*-*ai«#®H\ ±E 

c fc*««fcr*±E ( i ) {cies©Bfi5afisSc 40 

[0 14 5] C ©*»£&, 0171S0 5t^$n5»l 
Stt, /<9*-*fffli»3 2. 3 2 bfC*tJt>"f3„ 

[0146] ±E©*9ft««atj:ntf, /<v*-*a 

?4>tfiJMp&jURt>s. >^*-*©{g©$!Bli, ^ 



ftM¥ 1 1-215512 
30 

[0 14 7]^T, &HR|/<7*-*©ffl81£©ffffli 
£fl»!©T-*«;i&gi: L&^©T\ flMttfFfftfffig, 

[0 14 8] (8) ±E«7c1B88ffi¥8tt, ±E* 
±E (2) KEKOHftnaSII. 

[0149] c©«sKtt, neTiSBstc^snsiiz 

7-r f "7 t ? hlfffigp 7 0 tcttlS-f^o 

[o 1 50] cl?, ffl«a7c¥st<t o«tc« n^a 
«, ^©a^tcts^Ts ^©feff^fi^MiHw^-fti 

©B*©fefl^ffl^ <b fe *Ht«nfe«*«lS ^ 5 fif« 

&B*£&fcBU tettlSSSfCfSDTfefflia/W-*© 
ffilSttfcWWr*. 

[0 15 1] ftoT, a7cB«^5W^WK:7— 

[0 15 2] (9) ±EfeftH/<5*-*«ij£3® 
(4, ±Efi«BW«. -a©feffi^fflS, TfcWLTS 
T = dXS+|S 

(1) 75M (8) ©<srn^fcE«©is««ia*Ho 

[0 15 3] C©«B2tt, BlrtMB5fc:^2nS£l 
©HOtffcffStSo 

[0 15 4] ±E©«td**fiECJ:nfcr, fefflW^* 
T = a x S + 0 

[0155] seoT, s«aiia#ajc«toftia*n«ii 

fe*SM^7^-^©<B^tt^T^oT7— f^777 h 

[0156] en^, ±E©«uai?tt» wm<Dmmmw<D 
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So 

[0 1 5 7] (10) ±ffiftHIH/<7*-*«!3&#a 

5 c i: i: -T 5 ±B ( 9 ) »c8B«©H«fflaSHo 
[0 l 5 8] c<OM(i s HiftSBSKiSSnsSIl 

CO 1 5 9] ±8B©J:5a«j£EJ:nur, feffiH/^^ 
£> fefflM/ <5 * - * <9 o *> (D a zmtti LmfeM t f S o 

So 

CO 1 6 0] fcT, SH« 
CO 1 6 1 ] 

«<D£T0ttfifc"?7— r^77^ DfC < < fiOiS 
CO 1 6 2] $fc, *«Wt«tntf, fcSHiSfcttL^ 
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So 

C122] &mM¥f&&mwtzrcib(omx'&5a 
C03] fetaw^7^-^i:^©»aj^^Tsrc46 

C05] &mM'^*-$M&<D%)jfk*mwtzrzib<D 

CB6] *f|H^CD^2©^ffi©}g®(C^5il^ag 

So 

ch 7 ] fex-y i/ffiwictsifzwm*mwtzrzib<Dm 

T'&So 

das] tRtfJ3HB«fcfttt5fflsi*siiji!i-4fc*<DB 
C09] *«fwo*3©ii«so}g»s*c*»^sji»i!iaat 

-So 

Chi o] &ftm'^*-?<Dmmvmm*m.wtzrc 

i o m.=F*>f7 
1 2 saggg*** 

l 4 fftlfeCCD 
14. GCCD 
1 4* R / B rfiftj C C D 

1 6 A/D3>;\-^f 

1 8 

20 ^attias 

2 2 W|/<y7r 

24, 24a, 24b tfttff ffiilft 

2 6 7-f;l/^SEHfS^fROM 

2 8, 2 8 a, 2 8b /^7^ -^gtiJgP 

3 0 M7^-?A*777 
3 2, 3 2 b 

3 4 H«tt7C&! 

3 6, 3 6 a tti*jH«>W77 

5 8 #Miitsa5 

6 0 #MII^'y77 
6 2 7P-y^atBgP 

6 4 7D-y^5T|lJgP 

6 6 7n^^777 

6 8, 6 8 b 7n-y^7cg|3 

7 0 7— r-r 7 7 7 hffffiffi 
7 2 tn^HHIS 

7 4 aaw^ 
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